-- Logs begin at Fri 2022-10-28 19:16:08 UTC, end at Fri 2022-10-28 20:13:20 UTC. -- Oct 28 19:42:21.673953 dv-cinder-862365-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 28 19:42:21.682219 dv-cinder-862365-2-smb devstack@keystone.service[81531]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 19:42:21 2022] *** Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: nodename: dv-cinder-862365-2-smb Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: machine: x86_64 Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: clock source: unix Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: pcre jit disabled Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: detected number of CPU cores: 4 Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: current working directory: / Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: detected binary path: /usr/bin/uwsgi-core Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: your processes number limit is 47680 Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: your memory page size is 4096 bytes Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: detected max file descriptor number: 2048 Oct 28 19:42:21.684303 dv-cinder-862365-2-smb devstack@keystone.service[81531]: lock engine: pthread robust mutexes Oct 28 19:42:21.685699 dv-cinder-862365-2-smb devstack@keystone.service[81531]: thunder lock: enabled Oct 28 19:42:21.685699 dv-cinder-862365-2-smb devstack@keystone.service[81531]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 28 19:42:21.685699 dv-cinder-862365-2-smb devstack@keystone.service[81531]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 19:42:21.735209 dv-cinder-862365-2-smb devstack@keystone.service[81531]: Python main interpreter initialized at 0x56049387f9c0 Oct 28 19:42:21.735209 dv-cinder-862365-2-smb devstack@keystone.service[81531]: python threads support enabled Oct 28 19:42:21.735209 dv-cinder-862365-2-smb devstack@keystone.service[81531]: your server socket listen backlog is limited to 100 connections Oct 28 19:42:21.735209 dv-cinder-862365-2-smb devstack@keystone.service[81531]: your mercy for graceful operations on workers is 90 seconds Oct 28 19:42:21.735739 dv-cinder-862365-2-smb devstack@keystone.service[81531]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 19:42:21.735739 dv-cinder-862365-2-smb devstack@keystone.service[81531]: *** Operational MODE: preforking *** Oct 28 19:42:21.736101 dv-cinder-862365-2-smb devstack@keystone.service[81531]: *** uWSGI is running in multiple interpreter mode *** Oct 28 19:42:21.736101 dv-cinder-862365-2-smb devstack@keystone.service[81531]: spawned uWSGI master process (pid: 81531) Oct 28 19:42:21.736357 dv-cinder-862365-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 28 19:42:21.737692 dv-cinder-862365-2-smb devstack@keystone.service[81531]: spawned uWSGI worker 1 (pid: 81545, cores: 1) Oct 28 19:42:21.737851 dv-cinder-862365-2-smb devstack@keystone.service[81531]: spawned uWSGI worker 2 (pid: 81546, cores: 1) Oct 28 19:42:21.738246 dv-cinder-862365-2-smb devstack@keystone.service[81531]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 19:42:26.297324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:42:26.297324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: from cryptography.utils import int_from_bytes Oct 28 19:42:26.298732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:42:26.298732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: from cryptography.utils import int_from_bytes Oct 28 19:42:26.299097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:42:26.299097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: from cryptography.utils import int_from_bytes Oct 28 19:42:26.299924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 19:42:26.299924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: from cryptography.utils import int_from_bytes Oct 28 19:42:26.350306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:42:26.350559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:42:26.350683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] command line args: [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:42:26.350914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:42:26.351098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ================================================================================ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:42:26.351353 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] admin_token = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.351599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config_dir = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.351740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 19:42:26.351872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.352012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] config_source = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.352149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 19:42:26.352290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] debug = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.352290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.352678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] command line args: [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 19:42:26.352805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.352929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 19:42:26.353040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.353040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.353246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ================================================================================ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 19:42:26.353371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.353533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] admin_token = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.353655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.353776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_config_append = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.353894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config_dir = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_dir = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] config_source = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] debug = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.354973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.355428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.355615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.355847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.355847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.356168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.356298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.356298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.356607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.356800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.356800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.357111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.357247 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.357247 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.357577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.357722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.357850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.357987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.358122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_config_append = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.358307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.358436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.358633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.358777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_dir = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.358905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] publish_errors = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.358905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.359216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.359362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.359362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.359650 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.359779 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.359779 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.360069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.360276 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] standard_threads = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.360276 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.360609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.360790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.360790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.361077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.361222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_journal = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.361222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_json = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.361526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.361657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_stderr = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.361657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] use_syslog = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.361914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.362045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.362181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.362310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.362310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.362540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.362703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.362703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.362948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.363082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.363082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.363335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.363464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.363464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.363705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.363832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.364053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.364184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.364184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.364435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.364561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.364561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.364804 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.364926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.364926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.365145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.365284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.365284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.365284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.365656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.365789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.365920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.366060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] publish_errors = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.366195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.366195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.366440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.366564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.366702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.366836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.366836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.367083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.367212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.367212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.367462 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.367609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.367745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.367877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.368005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.368134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] standard_threads = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.368262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.368401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.368526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.368655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.368782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.368920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.369057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.369203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.369331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.369493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.369622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_journal = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.369747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.369876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_json = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.370111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.370250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_stderr = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.370378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.370378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.370611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] use_syslog = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.370737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.370879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.371013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 19:42:26.371142 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.371266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.371390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.371518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.371662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.371796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.371922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.372103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.372246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.372381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.372522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.372651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.372781 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.372968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.373112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.373246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.373414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.373567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.373696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.373874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.374015 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.374155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.374280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.374408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.374594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.374728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.374860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.375042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.375181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.375314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.375520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.375669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.375797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.375967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.376220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.376351 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.376487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.376623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.376749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.376876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.377018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.377149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.377272 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.377475 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.377621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.377744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.377886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.378057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.378192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.378320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.378526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.378672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.378806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.379049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.379179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.379315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.379472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.379618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.379755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.379880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.380006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.380170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.380311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.380451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.380620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.380782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.380912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.381106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.381278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.381458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.381607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.381733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.381849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.382387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.382510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.382510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.382729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.382851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.382851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383517 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.383862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.384986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.385246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.385666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.385939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.385939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.external = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.386324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.386536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.386732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.386922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.386922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.387288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.387499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.password = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.387499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] auth.token = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.387879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.388073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.388073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.388313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.388507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.388507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.388882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.389133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.389133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.389515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.389711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.389928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.390139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.390139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.390513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.390706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.390706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.391082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.391274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.391274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.391635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.391829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.391829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.392206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.392401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.392593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.392804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.392804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.393168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.393373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.393373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.393779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.393983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.394177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.394376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.394376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.394886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.395080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.395080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.395456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.395658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.395658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.396346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.396540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.396540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.396906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.397100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.397100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.397585 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.397780 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.397976 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.398469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.398469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.398847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.399056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.399056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.399411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.399603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.399603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.399973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.400179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.400179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.400537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.400781 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.400781 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.401158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.401365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.401584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.401792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.401792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.402155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.402371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.402371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.402735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.402944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.402944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.403319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.403511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.403511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.403893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.404113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.404113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.404479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.404671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.404864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.405068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.405068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.405469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.405655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.405655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.406021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.406213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.406213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.406608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.406802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.406802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.407165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.407362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.407362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.407745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.407939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.407939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.408303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.408499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.408499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.408891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.409083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.409083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.409484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.409679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.409898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.410231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.410231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.410602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.410796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.410796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.411171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.411364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.411561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.411756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.411756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.412134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.412349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.412349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.412715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.412907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.412907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.413271 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.413536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.413536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.413921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.414114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.414114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.414476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.414699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.414896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.415088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.415088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.415447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.415581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.415581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.415984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.416180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.416180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.416553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.416749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.416749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.417243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.417469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.417469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.417834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.418026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.418026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.418406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.418597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.418597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.418959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.419153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.419153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.419526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.419717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.419925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.420122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.420122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.420509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.420704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.420704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.421079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.421272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.421272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.421675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.421865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.421865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.422225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.422416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.422641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.422836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.422836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.423206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.423399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.423399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.423777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.423971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.423971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.424333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.424526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.424526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.424900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.425095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.425095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.425577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.425807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.425807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.426182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.426377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.426377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.426741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.426963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.426963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.427344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.external = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.427552 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.427742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.427953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.427953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.427953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.428499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.428692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.428889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.429078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.429078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.429461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.password = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.429676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.429676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.430036 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] auth.token = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.430233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.430233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.430616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.430826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.430826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.431210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.431408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.431408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.431758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.431963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.432155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.432348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.432348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.432719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.432910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.432910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.433300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.433527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.433721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.433928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.433928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.434310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.434525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.434525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.434901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.435097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.435097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.435472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.435683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.435875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.436070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.436070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.436440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.436630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.436630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.436993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.437190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.437190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.437677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.437873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.437873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.438235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.438438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.438438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.438824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.439019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.439019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.439381 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.439573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.439573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.439948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.440144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.440144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.440504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.440697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.440697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.441091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.441290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.441290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.441675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.441864 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.441864 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.442246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.442437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.442437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.442807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.443001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.443001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.443245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.443527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.443733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.443939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.443939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.444301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.444495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.444495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.444870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.445063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.445063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.445454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.445648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.445648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.446025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.446245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.446245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.446603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.446797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.446797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.447178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.447316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.447510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.447702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.447702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.448085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.448279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.448279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.448584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.448862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.448862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.449246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.449636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.449636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81546) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.450405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.452081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.453679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.455264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.456750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.458529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.460111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.460111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.460111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.460111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.460111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.460990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.460990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.461409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.461604 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.461969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.462335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.462700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.463073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.463438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.463787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.464153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.464508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.464860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.465221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.465458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.465678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.465875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.466070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.466270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.466542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.466901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.467273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.467621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.467986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.468341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.468702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.469056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.469487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.469837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.470187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.470543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.470914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.471280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.471642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.471995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.472360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.472768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.473128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.473534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.473890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.474245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.474608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.474812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.475030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.475384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.475750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.476116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.476477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.476850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.477211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.477615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.477979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.478346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.478696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.479080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.479447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.479813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.480177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.480729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.481082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.481493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.481863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.482230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.482598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.483307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.483516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.483797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.484161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.484510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.484862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.485212 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.485680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.486065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.486432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.486787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.487145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.487490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.487841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.488274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.488638 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.488997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.489447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.489783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.490139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.490508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.490868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.491230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.491583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.491936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.492287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.492658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.493044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.493429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.493790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.494180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.494566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.494927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.495304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.495660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.496020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.496374 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.496723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.497080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.497484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.497852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.498205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.498568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.498927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.499307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.499673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.500038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.500385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.500743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.501094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 19:42:26.501427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81545) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 19:42:26.504379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.504666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.528429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.528793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.529097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.538370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.558137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.558476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.561769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.601664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.613758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.614148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.638742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.639100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.778956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.779204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.779374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.779584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.779801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.780016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.783970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.784221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.784401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.784609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.784827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.785067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.804875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.805115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.805227 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.805359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.805550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.805684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.805831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.805959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.806084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.806214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.806341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.806479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.806603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.806603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.818341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.818579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.832130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.832383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.832383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.832630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.832759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.832937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.833074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.833204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.833334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.833510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.833646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.833795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.833929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81545) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.834058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81546) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 28 19:42:26.851605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.851966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.852154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:42:26.852296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:42:26.852506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.852648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.852788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:42:26.852943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 28 19:42:26.853082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.853216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.853348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.853608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.853760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.853892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.854024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.854186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.863286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.863586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.863792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.863940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.864114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.864259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.864438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.864438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.871432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.871939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.874494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.874789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.874971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.875157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.875358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.875530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.875666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.875843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.875979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.876119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.876295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.876404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.876527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.876677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.876848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.877005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.877127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.877261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.877491 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.877626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.877799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.877799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.901188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.901571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.902936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.903133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.903324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.903464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.908259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.908553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.908553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.908858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.908990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.909235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.915569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.916007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.916285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.916596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.920918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.921292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.921675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.922175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.922496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.922791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.923077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.923353 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.923631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.923905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.924175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.924371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.924754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.925169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.925490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.925859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.940411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.940690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.942342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.942701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.944831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.946874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.948177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.948477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.950288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.950782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.952789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.955324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.956077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.958838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.959458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.959762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.960048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.960343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.960629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.960908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.962553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.962925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.963285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.963765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.964116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.964491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.977556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.977888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.978160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.978423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.981573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.981948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.982283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.982619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.985488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.987078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.988722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.989001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.990340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.991712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.992007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.992249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.992393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.992561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.992976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.994177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.994542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.997290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:26.997670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.998016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.998372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:26.998713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.004445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.004723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.005024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.005305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.005750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.006042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.006323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.011032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.011408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.011764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.012111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.012476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.012824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.013175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.022073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.025406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.028433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.029772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.030009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.031515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.031799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.032214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.033273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.036737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.038274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.038865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.040144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.040373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.040608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.040815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.043357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.043770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.044055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.044335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.047876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.049499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.052385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.052629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.052818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.053033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.053218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.053450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.053632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.060356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81546) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.060742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.060953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.061214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.061501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.061776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.062123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.062334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.062540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.062762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.062963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.063164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.063378 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.063533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.063533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.063984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.063984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81546) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.070831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81545) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 28 19:42:27.071201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.071445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.071688 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.071949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.072151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.072390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.072621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.072858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.073059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.073310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.073603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.073876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.074165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81545) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 28 19:42:27.099720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56049387f9c0 pid: 81546 (default app) Oct 28 19:42:27.103367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65ac-5fdb-471e-98e7-f42cacfce04a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:27.103643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65ac-5fdb-471e-98e7-f42cacfce04a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:27.103915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed65ac-5fdb-471e-98e7-f42cacfce04a None None] PATH_INFO: `/v3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:27.108412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Fri Oct 28 19:42:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:27.111232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56049387f9c0 pid: 81545 (default app) Oct 28 19:42:34.206278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9ec3-0b38-44c8-9d22-6bfad8b1a1b5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:34.206880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9ec3-0b38-44c8-9d22-6bfad8b1a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:34.206880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9ec3-0b38-44c8-9d22-6bfad8b1a1b5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:34.208383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:42:34.217666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:34.218420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:34.218420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:34.294625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: INFO dbcounter [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] Registered counter for database keystone Oct 28 19:42:34.314999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG oslo_db.sqlalchemy.engines [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81545) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:42:34.323378 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writer thread running {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:42:34.531198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG passlib.handlers.bcrypt [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81545) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 19:42:34.531486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG passlib.handlers.bcrypt [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81545) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 19:42:34.592293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:34.594075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:34.773738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1/3] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:42:35.344382 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c9ec3-0b38-44c8-9d22-6bfad8b1a1b5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:35.417200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: INFO dbcounter [None req-c63c9ec3-0b38-44c8-9d22-6bfad8b1a1b5 None None] Registered counter for database keystone Oct 28 19:42:35.444045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG oslo_db.sqlalchemy.engines [None req-c63c9ec3-0b38-44c8-9d22-6bfad8b1a1b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81546) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 28 19:42:35.451904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writer thread running {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 19:42:35.623200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c9ec3-0b38-44c8-9d22-6bfad8b1a1b5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:35.630037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c918f-8fe9-424c-aa3c-4cacb00f4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:35.630934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c918f-8fe9-424c-aa3c-4cacb00f4281 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:35.631223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c918f-8fe9-424c-aa3c-4cacb00f4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:35.631545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c918f-8fe9-424c-aa3c-4cacb00f4281 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:35.644813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c918f-8fe9-424c-aa3c-4cacb00f4281 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:35.727405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING keystone.common.rbac_enforcer.enforcer [None req-628c918f-8fe9-424c-aa3c-4cacb00f4281 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 19:42:35.727851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628c918f-8fe9-424c-aa3c-4cacb00f4281 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:35.743030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 3/4] 10.222.0.52 () {58 vars in 1324 bytes} [Fri Oct 28 19:42:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:42:35.750037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:35.779168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f222c7b-cf38-421d-b4e5-4e46cfaf4074 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:35.786890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980df2e-279d-47e3-8c80-605eee0ac1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:35.789170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980df2e-279d-47e3-8c80-605eee0ac1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:35.789684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980df2e-279d-47e3-8c80-605eee0ac1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:35.790133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980df2e-279d-47e3-8c80-605eee0ac1d3 admin admin] PATH_INFO: `/v3/projects/46afb98b47654c2ebe18eaaa061df1b1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:35.792911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980df2e-279d-47e3-8c80-605eee0ac1d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=46afb98b47654c2ebe18eaaa061df1b1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:35.905447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2980df2e-279d-47e3-8c80-605eee0ac1d3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 28 19:42:35.905686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980df2e-279d-47e3-8c80-605eee0ac1d3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:35.910482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 2/5] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Oct 28 19:42:35 2022] GET /identity/v3/projects/46afb98b47654c2ebe18eaaa061df1b1 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:38.291688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41d07-cc7b-4a9c-b281-a64122dcbd82 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.292326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41d07-cc7b-4a9c-b281-a64122dcbd82 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.292326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a41d07-cc7b-4a9c-b281-a64122dcbd82 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.299395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 4/6] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:42:38.306746 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c24d-b839-48aa-8e8b-bb566400c7c9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.307371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c24d-b839-48aa-8e8b-bb566400c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.307371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8c24d-b839-48aa-8e8b-bb566400c7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.332915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a8e8c24d-b839-48aa-8e8b-bb566400c7c9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:38.334622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a8e8c24d-b839-48aa-8e8b-bb566400c7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:38.343697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:42:38.613924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a41d07-cc7b-4a9c-b281-a64122dcbd82 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:38.627151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a41d07-cc7b-4a9c-b281-a64122dcbd82 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:38.631953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2cdcd-cc0b-4e05-9ed9-5191a9e9f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:38.632609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2cdcd-cc0b-4e05-9ed9-5191a9e9f840 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.632934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2cdcd-cc0b-4e05-9ed9-5191a9e9f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.633252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2cdcd-cc0b-4e05-9ed9-5191a9e9f840 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.642387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2cdcd-cc0b-4e05-9ed9-5191a9e9f840 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:38.644327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2cdcd-cc0b-4e05-9ed9-5191a9e9f840 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:38.655378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1324 bytes} [Fri Oct 28 19:42:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:42:38.663174 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c24d-b839-48aa-8e8b-bb566400c7c9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:38.673813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8c24d-b839-48aa-8e8b-bb566400c7c9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:38.678561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486613-c255-4a20-9ced-3faeb5de11a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:38.679276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486613-c255-4a20-9ced-3faeb5de11a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:38.679599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486613-c255-4a20-9ced-3faeb5de11a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:38.679908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486613-c255-4a20-9ced-3faeb5de11a0 admin admin] PATH_INFO: `/v3/users/b9dddedf69f943debb0792966846ece1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:38.681416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32486613-c255-4a20-9ced-3faeb5de11a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=b9dddedf69f943debb0792966846ece1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:38.683369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32486613-c255-4a20-9ced-3faeb5de11a0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:38.685253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 4/9] 10.222.0.52 () {56 vars in 1198 bytes} [Fri Oct 28 19:42:38 2022] GET /identity/v3/users/b9dddedf69f943debb0792966846ece1 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:41.054143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a081cf-3c0d-4658-914a-5edf576229f3 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.054793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a081cf-3c0d-4658-914a-5edf576229f3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.055130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a081cf-3c0d-4658-914a-5edf576229f3 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.057836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:41.064092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1eba-4071-4c48-8131-6cb429be8544 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.064987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1eba-4071-4c48-8131-6cb429be8544 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.064987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1eba-4071-4c48-8131-6cb429be8544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.085100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a18f1eba-4071-4c48-8131-6cb429be8544 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:41.086537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a18f1eba-4071-4c48-8131-6cb429be8544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:41.204991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 5/11] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:42:41.230404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf889f4-fe89-4a71-b025-ced1b04044ba None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.230811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf889f4-fe89-4a71-b025-ced1b04044ba None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.231166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf889f4-fe89-4a71-b025-ced1b04044ba None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.232640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 7/12] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:41.239476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5554d-02f3-4090-89b9-923ed4f68d3f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.239823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5554d-02f3-4090-89b9-923ed4f68d3f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.240164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5554d-02f3-4090-89b9-923ed4f68d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.261034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-33d5554d-02f3-4090-89b9-923ed4f68d3f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:41.262401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-33d5554d-02f3-4090-89b9-923ed4f68d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:41.284023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:41.362609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 6/13] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:42:41.671713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf889f4-fe89-4a71-b025-ced1b04044ba None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.705049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5554d-02f3-4090-89b9-923ed4f68d3f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.826558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5554d-02f3-4090-89b9-923ed4f68d3f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:41.854245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf889f4-fe89-4a71-b025-ced1b04044ba None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:41.871069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:41.872058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.872362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.872647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.887350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:41.896862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:42:41.897606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:42:41.899641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:42:41.900547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:42:41.901179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:41.901254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:42:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:41.901317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:41.901317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:41.901990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:41.903702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:41.906907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.917496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.sql.core [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:42:41.917496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:42:41.917496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [parameters: {'id': '110aee753d054adfa1a77a22ff68dbed', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:42:41.917496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81546) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:42:41.925226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:42:41.937412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 19:42:41.939769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application yield resource Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise self.value Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application session.commit() Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:42:41.942921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:42:41.944784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:42:41.946429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:42:41.947821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [parameters: {'id': '110aee753d054adfa1a77a22ff68dbed', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 19:42:41.949115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:42:41.950487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 8/15] 10.222.0.52 () {60 vars in 1137 bytes} [Fri Oct 28 19:42:41 2022] POST /identity/v3/domains => generated 190 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:41.951516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:41.996302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:42.056348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30d072-ac9c-48ad-b9e1-58c43e72e636 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.094077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d01a83-2ddc-4fea-83f4-236310e0c382 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.106103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.107734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.107734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.108253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.108743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:42.109024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.110844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.124539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 8/16] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:42:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:42.131259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.153969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.154869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.155155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.155422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.178853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.180502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:42:42.199175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:42:42.200801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:42:42.202373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:42:42.202373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:42.202373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:42.202373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:42:42.208207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.239809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:42.271240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd0079-f46e-4da8-b313-d0dfc5fe636c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.307889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.308508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.308782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.309052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] PATH_INFO: `/v3/users/b9dddedf69f943debb0792966846ece1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.310371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] RBAC: Authorizing `identity:get_user(user_id=b9dddedf69f943debb0792966846ece1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.311915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.313672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 9/18] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/users/b9dddedf69f943debb0792966846ece1 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:42.316828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:42.319613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.330382 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e1925-7105-4c1b-b766-42f43c558651 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.375018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.375642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.375921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.376183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.376856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:42.377144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.378627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.399125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 10/19] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:42.439798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd44c3-55b4-4538-a656-a4881ee8cd71 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.480620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d491ac-1a80-40ba-bd6b-1ff141dcf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.481280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d491ac-1a80-40ba-bd6b-1ff141dcf729 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.481623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d491ac-1a80-40ba-bd6b-1ff141dcf729 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.481860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d491ac-1a80-40ba-bd6b-1ff141dcf729 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.483132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d491ac-1a80-40ba-bd6b-1ff141dcf729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.484667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d491ac-1a80-40ba-bd6b-1ff141dcf729 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.486411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 10/20] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:42.494045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:42.628342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802caa9-5be5-4a9c-b5ed-6d8102e39d3d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:42.669746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc6e75-867d-4426-9569-6b1b20a1adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:42.670436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc6e75-867d-4426-9569-6b1b20a1adb4 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:42.670688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc6e75-867d-4426-9569-6b1b20a1adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:42.670975 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc6e75-867d-4426-9569-6b1b20a1adb4 None admin] PATH_INFO: `/v3/domains/default/users/b9dddedf69f943debb0792966846ece1/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:42.673330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc6e75-867d-4426-9569-6b1b20a1adb4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b9dddedf69f943debb0792966846ece1, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:42.674864 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc6e75-867d-4426-9569-6b1b20a1adb4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:42.799098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 11/21] 10.222.0.52 () {58 vars in 1361 bytes} [Fri Oct 28 19:42:42 2022] PUT /identity/v3/domains/default/users/b9dddedf69f943debb0792966846ece1/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:42:46.043503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc12fb-9161-4f14-8769-5e6f3c701399 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.045142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc12fb-9161-4f14-8769-5e6f3c701399 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.046025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc12fb-9161-4f14-8769-5e6f3c701399 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.051471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 11/22] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:46.057561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.059066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.059812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.086471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG passlib.handlers.bcrypt [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81546) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 28 19:42:46.086902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG passlib.handlers.bcrypt [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81546) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 28 19:42:46.146184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:46.147719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:46.169343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:46.169981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c79c4d-6c6d-4a2a-a654-813501e8caa5 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.170500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c79c4d-6c6d-4a2a-a654-813501e8caa5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.170960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c79c4d-6c6d-4a2a-a654-813501e8caa5 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.172913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 12/23] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:46.182960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79c042-22dd-42e3-8598-be3aba0023b0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.183546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79c042-22dd-42e3-8598-be3aba0023b0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.184016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79c042-22dd-42e3-8598-be3aba0023b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.227146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7e79c042-22dd-42e3-8598-be3aba0023b0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:46.229048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7e79c042-22dd-42e3-8598-be3aba0023b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:46.236199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:46.344107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 12/24] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:42:46.392380 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 13/25] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:42:46.807846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:46.956968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7210a9-0012-42b1-b25c-7b90ceccf782 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.957218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7210a9-0012-42b1-b25c-7b90ceccf782 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.957544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7210a9-0012-42b1-b25c-7b90ceccf782 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.958914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 14/26] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:42:46.965091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f714-d136-46f5-be08-4134bb85d97c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:46.965427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f714-d136-46f5-be08-4134bb85d97c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:46.965690 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f714-d136-46f5-be08-4134bb85d97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:46.985313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb0baa-af1b-4322-a8f7-ded573b9672c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.004045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fad2f714-d136-46f5-be08-4134bb85d97c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:47.005298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fad2f714-d136-46f5-be08-4134bb85d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:47.064295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2cc58-df83-41c8-921d-032db6f99499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.065236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cc58-df83-41c8-921d-032db6f99499 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.065555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cc58-df83-41c8-921d-032db6f99499 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.065833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2cc58-df83-41c8-921d-032db6f99499 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.076687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:47.082687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d2cc58-df83-41c8-921d-032db6f99499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a0d2cc58-df83-41c8-921d-032db6f99499 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:42:47.089262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:42:47.090755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 13/27] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:42:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:47.091919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3ecc-4e9b-4504-b6fb-459a1f72388c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.093144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3ecc-4e9b-4504-b6fb-459a1f72388c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.093144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d3ecc-4e9b-4504-b6fb-459a1f72388c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.096810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 14/28] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:47.102667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e621f3-382e-4382-bdca-ae6a4cf13d20 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.103002 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e621f3-382e-4382-bdca-ae6a4cf13d20 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.103195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e621f3-382e-4382-bdca-ae6a4cf13d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.124312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f5e621f3-382e-4382-bdca-ae6a4cf13d20 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:47.125581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f5e621f3-382e-4382-bdca-ae6a4cf13d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:47.216465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Oct 28 19:42:47.218206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f714-d136-46f5-be08-4134bb85d97c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.299385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 15/30] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:42:47.301283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e621f3-382e-4382-bdca-ae6a4cf13d20 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.324078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:47.383894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f714-d136-46f5-be08-4134bb85d97c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.483180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e621f3-382e-4382-bdca-ae6a4cf13d20 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.506574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41978424-e499-4030-aff9-46825a0742d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.507891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978424-e499-4030-aff9-46825a0742d2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.508385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978424-e499-4030-aff9-46825a0742d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.508879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41978424-e499-4030-aff9-46825a0742d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.510218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41978424-e499-4030-aff9-46825a0742d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:47.510763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41978424-e499-4030-aff9-46825a0742d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.513392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41978424-e499-4030-aff9-46825a0742d2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.519698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:47.533927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.535004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.535505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.535997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.536611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 16/31] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:47.537332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.539406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126e26-3b05-40ca-8391-889e830a0f2d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.539603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.540365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126e26-3b05-40ca-8391-889e830a0f2d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.541067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f126e26-3b05-40ca-8391-889e830a0f2d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.543900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 17/32] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:47.545761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f126e26-3b05-40ca-8391-889e830a0f2d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.572165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 16/33] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Oct 28 19:42:47 2022] POST /identity/v3/roles => generated 219 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:47.574599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.690075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f126e26-3b05-40ca-8391-889e830a0f2d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.766738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:47.777104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2160b436-e057-4dd1-9e5a-756d7cb3dc57 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:47.778588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016d7858-4c35-4de8-80a0-60f42b5dcf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.781481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7858-4c35-4de8-80a0-60f42b5dcf60 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.781838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7858-4c35-4de8-80a0-60f42b5dcf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.782103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016d7858-4c35-4de8-80a0-60f42b5dcf60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.802752 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d7858-4c35-4de8-80a0-60f42b5dcf60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.804528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016d7858-4c35-4de8-80a0-60f42b5dcf60 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-016d7858-4c35-4de8-80a0-60f42b5dcf60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:42:47.825103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:42:47.826754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:42:47.828899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:42:47.828899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:42:47.828899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:42:47.831450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 18/34] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:42:47.832991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8e37-c2d2-454f-942e-8b8696234ff1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.833282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8e37-c2d2-454f-942e-8b8696234ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.833732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c8e37-c2d2-454f-942e-8b8696234ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.861025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:47.862245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-879c8e37-c2d2-454f-942e-8b8696234ff1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:47.862729 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:47.863475 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:47.863843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-879c8e37-c2d2-454f-942e-8b8696234ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:47.864390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] PATH_INFO: `/v3/users/b9dddedf69f943debb0792966846ece1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:47.867719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] RBAC: Authorizing `identity:get_user(user_id=b9dddedf69f943debb0792966846ece1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:47.870936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:47.874653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 17/35] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/users/b9dddedf69f943debb0792966846ece1 => generated 247 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:47.881194 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:47.981296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:47.995107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 19/36] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:42:47.996826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8e37-c2d2-454f-942e-8b8696234ff1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:48.054536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0cd50-c102-43eb-b57f-edd6cac4231b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.099424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.101066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.101535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.101945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.102802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.104492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.122355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Oct 28 19:42:47 2022] POST /identity/v3/roles => generated 225 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:48.123573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:48.179170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c8e37-c2d2-454f-942e-8b8696234ff1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.204309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:48.239955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.240903 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.241073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.241195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.241937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:48.242242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.243796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.279977 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:42:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:48.281270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:48.338539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0c4d0-3949-4216-8c8d-68a46bf302bf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.359982 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:48.386261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.387034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.387564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.387669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.388990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.390649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.392707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 19/39] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:48.393339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:48.465720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7b02d-383f-4b30-94ac-b313fb6281a9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.534494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e74749-4f34-401e-b0f9-df67b02d2385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.535630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74749-4f34-401e-b0f9-df67b02d2385 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.536115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74749-4f34-401e-b0f9-df67b02d2385 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.536579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74749-4f34-401e-b0f9-df67b02d2385 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.539461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e74749-4f34-401e-b0f9-df67b02d2385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.541292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e74749-4f34-401e-b0f9-df67b02d2385 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.544037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 21/40] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:48.545833 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456ccd-e2e8-4d93-b80e-21f1e21d80eb None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.546318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456ccd-e2e8-4d93-b80e-21f1e21d80eb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.546802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a456ccd-e2e8-4d93-b80e-21f1e21d80eb None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.549330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 22/41] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:48.552261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a456ccd-e2e8-4d93-b80e-21f1e21d80eb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:48.554914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9cfb5-49c1-43ea-8c60-6944a52b87b7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.602463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.603522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.604024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.604549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.605903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.608838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.615421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:48.655908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 20/42] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:42:48 2022] POST /identity/v3/projects => generated 301 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:48.657673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:48.713796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a456ccd-e2e8-4d93-b80e-21f1e21d80eb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.731081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:48.780255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a129f59-0088-44b1-a328-a7072e3b562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.781265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129f59-0088-44b1-a328-a7072e3b562e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.781777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129f59-0088-44b1-a328-a7072e3b562e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.782198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a129f59-0088-44b1-a328-a7072e3b562e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.783489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a129f59-0088-44b1-a328-a7072e3b562e None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.domain.id=default, user.id=b9dddedf69f943debb0792966846ece1) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:42:48.783966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a129f59-0088-44b1-a328-a7072e3b562e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.786755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a129f59-0088-44b1-a328-a7072e3b562e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.807312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 23/43] 10.222.0.52 () {56 vars in 1322 bytes} [Fri Oct 28 19:42:48 2022] GET /identity/v3/role_assignments?user.id=b9dddedf69f943debb0792966846ece1&scope.domain.id=default&role.id=16542b0f593541a195074d7863391bd7 => generated 530 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:48.807312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045226-3e96-4dfe-84eb-d166fd477ee7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.807312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045226-3e96-4dfe-84eb-d166fd477ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.807312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f045226-3e96-4dfe-84eb-d166fd477ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.832914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9f045226-3e96-4dfe-84eb-d166fd477ee7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:48.833743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf4fa-aa19-4bb0-b55b-bfdc938e7f11 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:48.835064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9f045226-3e96-4dfe-84eb-d166fd477ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:48.904684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:48.905707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:48.906330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:48.906771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:48.907902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:48.910642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:48.964527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 21/44] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:42:48 2022] POST /identity/v3/projects => generated 312 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:48.986446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 24/45] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:42:49.474188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:49.589161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:49.603236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8ce19-c8d1-483d-993c-f8ab405595e7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:49.646673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf0eaa-d8fb-43ed-9ec3-27b7ec4f1d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:49.647855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf0eaa-d8fb-43ed-9ec3-27b7ec4f1d5e None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:49.648364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf0eaa-d8fb-43ed-9ec3-27b7ec4f1d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:49.649200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf0eaa-d8fb-43ed-9ec3-27b7ec4f1d5e None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:49.650604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf0eaa-d8fb-43ed-9ec3-27b7ec4f1d5e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:49.653668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf0eaa-d8fb-43ed-9ec3-27b7ec4f1d5e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:49.674572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 22/46] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Oct 28 19:42:49 2022] POST /identity/v3/roles => generated 223 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:51.262574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77246761-c07a-4435-b4cb-2919d2070380 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.263195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77246761-c07a-4435-b4cb-2919d2070380 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.263748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77246761-c07a-4435-b4cb-2919d2070380 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.265416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 25/47] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:51.273198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3e811-a07e-4556-a84b-f570c490c4d7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.274256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3e811-a07e-4556-a84b-f570c490c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.274642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3e811-a07e-4556-a84b-f570c490c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.307080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-bde3e811-a07e-4556-a84b-f570c490c4d7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:51.308891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bde3e811-a07e-4556-a84b-f570c490c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:51.434243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 23/48] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:42:51.707100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77246761-c07a-4435-b4cb-2919d2070380 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:51.750344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:51.826266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77246761-c07a-4435-b4cb-2919d2070380 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:51.864286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c76dd3-19d0-4291-b1cf-ccf8dc985030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:51.864974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76dd3-19d0-4291-b1cf-ccf8dc985030 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:51.865250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76dd3-19d0-4291-b1cf-ccf8dc985030 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:51.865575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c76dd3-19d0-4291-b1cf-ccf8dc985030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:51.866795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76dd3-19d0-4291-b1cf-ccf8dc985030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:51.868321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c76dd3-19d0-4291-b1cf-ccf8dc985030 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:51.869991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 26/49] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:42:51.876184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3e811-a07e-4556-a84b-f570c490c4d7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:51.974333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:51.999370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3e811-a07e-4556-a84b-f570c490c4d7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:52.153468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034373d-8aa6-4360-bbab-36e30b70cc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:52.154264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034373d-8aa6-4360-bbab-36e30b70cc65 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:52.154573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034373d-8aa6-4360-bbab-36e30b70cc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:52.154897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034373d-8aa6-4360-bbab-36e30b70cc65 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:52.155591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034373d-8aa6-4360-bbab-36e30b70cc65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:52.157112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034373d-8aa6-4360-bbab-36e30b70cc65 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:52.188449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 24/50] 10.222.0.52 () {60 vars in 1140 bytes} [Fri Oct 28 19:42:51 2022] POST /identity/v3/projects => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:54.589733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210670ab-5021-4571-8428-5ec02e01c570 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:54.590308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210670ab-5021-4571-8428-5ec02e01c570 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:54.590418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210670ab-5021-4571-8428-5ec02e01c570 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:54.591897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 27/51] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:54.598307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e0562-5278-453f-8144-9a3105d0ea5c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:54.598862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e0562-5278-453f-8144-9a3105d0ea5c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:54.598862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e0562-5278-453f-8144-9a3105d0ea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:54.618405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-162e0562-5278-453f-8144-9a3105d0ea5c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:54.619650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-162e0562-5278-453f-8144-9a3105d0ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:54.699724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 25/52] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:42:54.971829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210670ab-5021-4571-8428-5ec02e01c570 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:55.093867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210670ab-5021-4571-8428-5ec02e01c570 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:55.096699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:55.137003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990b241-5fa6-46bf-95ba-2b78166e5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:55.137722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b241-5fa6-46bf-95ba-2b78166e5080 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:55.138017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b241-5fa6-46bf-95ba-2b78166e5080 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:55.138290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b241-5fa6-46bf-95ba-2b78166e5080 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:55.139584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990b241-5fa6-46bf-95ba-2b78166e5080 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:55.141141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990b241-5fa6-46bf-95ba-2b78166e5080 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:55.142814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 28/53] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:42:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:42:55.149622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e0562-5278-453f-8144-9a3105d0ea5c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:42:55.220232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:42:55.267574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e0562-5278-453f-8144-9a3105d0ea5c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:42:55.309996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebc0a9-fc61-4bd2-bbac-f80d832c099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:42:55.310647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc0a9-fc61-4bd2-bbac-f80d832c099c None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:55.310934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc0a9-fc61-4bd2-bbac-f80d832c099c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:55.311207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebc0a9-fc61-4bd2-bbac-f80d832c099c None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:55.311865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebc0a9-fc61-4bd2-bbac-f80d832c099c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:42:55.313412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebc0a9-fc61-4bd2-bbac-f80d832c099c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:42:55.346059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 26/54] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:42:55 2022] POST /identity/v3/users => generated 275 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:42:59.678752 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed229001-e2e0-4f54-a7b3-b1e92f66a8f2 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:59.680249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed229001-e2e0-4f54-a7b3-b1e92f66a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:59.680958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed229001-e2e0-4f54-a7b3-b1e92f66a8f2 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:59.683708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 29/55] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:42:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:42:59.690722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908ede-011f-4b15-9336-ceaed2326617 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:42:59.692243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908ede-011f-4b15-9336-ceaed2326617 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:42:59.692966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98908ede-011f-4b15-9336-ceaed2326617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:42:59.739435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-98908ede-011f-4b15-9336-ceaed2326617 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:42:59.741968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-98908ede-011f-4b15-9336-ceaed2326617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:42:59.892004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 27/56] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:00.348312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf27e6-4896-4bdb-8ea6-5c81f95f5f60 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.349025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf27e6-4896-4bdb-8ea6-5c81f95f5f60 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.349551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf27e6-4896-4bdb-8ea6-5c81f95f5f60 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.351233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 30/57] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:00.357102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635239d2-bcb7-4082-ab5d-b1618a09ab90 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.357745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635239d2-bcb7-4082-ab5d-b1618a09ab90 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.358332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635239d2-bcb7-4082-ab5d-b1618a09ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.370006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275250b3-ad6b-4f23-b395-f014a1a3902c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.370641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275250b3-ad6b-4f23-b395-f014a1a3902c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.371121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275250b3-ad6b-4f23-b395-f014a1a3902c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.372705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 31/58] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:00.384969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-635239d2-bcb7-4082-ab5d-b1618a09ab90 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:00.386644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-635239d2-bcb7-4082-ab5d-b1618a09ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:00.404965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ebaa-3029-49bd-998f-7f48f171f53a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.405660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ebaa-3029-49bd-998f-7f48f171f53a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.406128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092ebaa-3029-49bd-998f-7f48f171f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.432652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2092ebaa-3029-49bd-998f-7f48f171f53a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:00.434659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2092ebaa-3029-49bd-998f-7f48f171f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:00.448833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:00.477606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 28/59] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:00.479427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05653eb-e613-4225-93eb-e9d26061a57d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.479992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05653eb-e613-4225-93eb-e9d26061a57d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.480463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05653eb-e613-4225-93eb-e9d26061a57d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.482497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 29/60] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:00.483595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05653eb-e613-4225-93eb-e9d26061a57d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.579202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 32/61] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:00.581565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c81f-4a1d-452c-98a5-0f7711086b1f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.582133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c81f-4a1d-452c-98a5-0f7711086b1f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.583080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c81f-4a1d-452c-98a5-0f7711086b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.605860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05653eb-e613-4225-93eb-e9d26061a57d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:00.616366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2605c81f-4a1d-452c-98a5-0f7711086b1f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:00.618719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2605c81f-4a1d-452c-98a5-0f7711086b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:00.648125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:00.649646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.650152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.650765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.664947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:00.670461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:00.671364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:00.672150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:00.674891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 30/62] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:43:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:00.684848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.769414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 33/63] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:00.786650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:00.900514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c81f-4a1d-452c-98a5-0f7711086b1f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:00.937767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65ef53-9d3a-4bfa-ba12-5b0860b64198 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:00.979337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:00.980386 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:00.980877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:00.981353 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:00.982293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:00.982992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:00.984139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:00.985698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:00.999188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 31/64] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:43:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:01.008082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.163718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.167592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90295b96-ece3-494e-95d0-6b3dd4563c0e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.216068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.216729 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.217015 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.217304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] PATH_INFO: `/v3/users/1f7211cec2b84394b2a5f0d2d69692c9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.232178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c81f-4a1d-452c-98a5-0f7711086b1f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.234452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] RBAC: Authorizing `identity:get_user(user_id=1f7211cec2b84394b2a5f0d2d69692c9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.235969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.237807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 32/65] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/users/1f7211cec2b84394b2a5f0d2d69692c9 => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:01.238705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.287155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.288193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.288599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.305158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:01.311322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:01.312262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:01.313029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 34/66] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:01.314966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.368346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9938c-272d-4455-9c13-cd02267a3a7f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.408830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.409512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.409875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.410153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.422386 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:01.423419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:01.428229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:01.429845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 33/67] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:01.430607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.440694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a005ec-61b2-4467-9de4-7811e69ca018 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.450744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.482901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843d507-70e0-4173-9701-014626158ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.484071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d507-70e0-4173-9701-014626158ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.484547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d507-70e0-4173-9701-014626158ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.485024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d507-70e0-4173-9701-014626158ed5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.501221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843d507-70e0-4173-9701-014626158ed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a843d507-70e0-4173-9701-014626158ed5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:01.506435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:01.508150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 35/68] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:01.509773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04605-f04d-4a57-82cf-310e7ea7eca6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.511253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04605-f04d-4a57-82cf-310e7ea7eca6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.511253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec04605-f04d-4a57-82cf-310e7ea7eca6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.512146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 36/69] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:01.512324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04605-f04d-4a57-82cf-310e7ea7eca6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.558673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fdeca-aae2-4ee6-82a6-9f3b5ac7d051 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.598824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.599591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.599957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.600374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.601875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.603530 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.605335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 34/70] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:01.611153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.642924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec04605-f04d-4a57-82cf-310e7ea7eca6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.684023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.684819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.685284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.685741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.686669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:01.687061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.688630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.698597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 37/71] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:01.699769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.721691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.723626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:01.744129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6c426-a973-4b4b-9e5d-1c4a01c8b06f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.795052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763b9b0-7b8f-4feb-a592-e3254d9e18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.795734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763b9b0-7b8f-4feb-a592-e3254d9e18b8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.795972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763b9b0-7b8f-4feb-a592-e3254d9e18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.796251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763b9b0-7b8f-4feb-a592-e3254d9e18b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.796958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763b9b0-7b8f-4feb-a592-e3254d9e18b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:01.797269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763b9b0-7b8f-4feb-a592-e3254d9e18b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.798785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763b9b0-7b8f-4feb-a592-e3254d9e18b8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.808898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 35/72] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:01.810244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f063-9930-41e0-98b5-4fe4d26cd523 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.810542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f063-9930-41e0-98b5-4fe4d26cd523 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.810834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e0f063-9930-41e0-98b5-4fe4d26cd523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.831377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e8e0f063-9930-41e0-98b5-4fe4d26cd523 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:01.832697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e8e0f063-9930-41e0-98b5-4fe4d26cd523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:01.849646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e59e5db-1bc8-4355-b809-87341af29ec5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:01.888733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:01.889409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:01.889679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:01.889948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:01.890629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:01.890939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:01.892377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:01.901981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 38/73] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:01.902846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:01.916010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 36/74] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:01.916932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0f063-9930-41e0-98b5-4fe4d26cd523 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.005595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:02.019043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:02.040728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0cd2d-3863-4676-bcc5-ce19e5854cd3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.047065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e0f063-9930-41e0-98b5-4fe4d26cd523 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.087475 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.088159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.088306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.088448 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.088716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] PATH_INFO: `/v3/users/1f7211cec2b84394b2a5f0d2d69692c9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.089216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.089687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.090083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/1f7211cec2b84394b2a5f0d2d69692c9/roles/3b63b6b8ba3a43158d1be9fe4d2322d5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.090341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] RBAC: Authorizing `identity:get_user(user_id=1f7211cec2b84394b2a5f0d2d69692c9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.091848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.092844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e08162201c94003bcd1bfda733b4fdc, user_id=1f7211cec2b84394b2a5f0d2d69692c9, role_id=3b63b6b8ba3a43158d1be9fe4d2322d5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.093525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:01 2022] GET /identity/v3/users/1f7211cec2b84394b2a5f0d2d69692c9 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:02.094333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.098679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.219936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 39/76] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:01 2022] PUT /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/1f7211cec2b84394b2a5f0d2d69692c9/roles/3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:02.221222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.225091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6021c088-e3d5-4aaa-932e-38f87a8ecc3b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.270448 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.271004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.271288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.271565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] PATH_INFO: `/v3/users/1f7211cec2b84394b2a5f0d2d69692c9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.272857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] RBAC: Authorizing `identity:get_user(user_id=1f7211cec2b84394b2a5f0d2d69692c9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.275149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.282908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 38/77] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:02 2022] GET /identity/v3/users/1f7211cec2b84394b2a5f0d2d69692c9 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:02.282908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.304324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:02.375143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c45b6-e488-45c6-a355-f4c9e7c3a8e3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.423169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4bd37-4fe2-4b4b-b1f5-aff1dd376431 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.425122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.426068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.426536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.426985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] PATH_INFO: `/v3/users/b9dddedf69f943debb0792966846ece1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.429188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] RBAC: Authorizing `identity:get_user(user_id=b9dddedf69f943debb0792966846ece1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.431194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.436998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 40/78] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:02 2022] GET /identity/v3/users/b9dddedf69f943debb0792966846ece1 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:02.438589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.445607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:02.476882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.477703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.477984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.478253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] PATH_INFO: `/v3/projects/95f37fa82291498cbf8b5b8c00665906` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.479511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] RBAC: Authorizing `identity:get_project(project_id=95f37fa82291498cbf8b5b8c00665906)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.481057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.483159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 39/79] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:02 2022] GET /identity/v3/projects/95f37fa82291498cbf8b5b8c00665906 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:02.489544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.593505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ca241-ae4b-4084-85ce-401a90833b7e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.595802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:02.618700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2b64b-bd6d-4f1e-b373-3474d79f2d23 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.641712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.642614 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.643150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.643603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.645288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.647322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.650163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 41/80] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:02.651207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.662069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.662732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.663121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.663330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.664553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.666097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.668187 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 40/81] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:02 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:02.673612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.751917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:02.788477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def82a3-a619-46c6-926f-70853fd3094e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.819530 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c220c8-b96e-4bc5-a8a5-f87d710a6afc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:02.832361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.833135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.833500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.833850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.835111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.836646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.841108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 42/82] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:02 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:02.846692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.872359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:02.873334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:02.873822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:02.874285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] PATH_INFO: `/v3/projects/95f37fa82291498cbf8b5b8c00665906/users/1f7211cec2b84394b2a5f0d2d69692c9/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:02.876807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] RBAC: Authorizing `identity:create_grant(project_id=95f37fa82291498cbf8b5b8c00665906, user_id=1f7211cec2b84394b2a5f0d2d69692c9, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:02.879039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:02.896630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 41/83] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:02 2022] PUT /identity/v3/projects/95f37fa82291498cbf8b5b8c00665906/users/1f7211cec2b84394b2a5f0d2d69692c9/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:02.898317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:02.925732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:03.033836 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362b973-4c42-4b46-9ec3-71beff85c640 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:03.108803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:03.109774 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:03.110264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de9324-ff88-42f3-88e3-92a859929a4d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:03.110422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:03.110747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:03.111966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:03.115144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:03.147912 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:03.169099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 43/84] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:43:02 2022] POST /identity/v3/users => generated 289 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:43:03.170442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:03.180355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8dc4e-eff4-4b5a-8c94-63664eb2e1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:03.181432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dc4e-eff4-4b5a-8c94-63664eb2e1ad None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:03.181942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dc4e-eff4-4b5a-8c94-63664eb2e1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:03.182389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8dc4e-eff4-4b5a-8c94-63664eb2e1ad None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/1f7211cec2b84394b2a5f0d2d69692c9/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:03.186010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8dc4e-eff4-4b5a-8c94-63664eb2e1ad None admin] RBAC: Authorizing `identity:create_grant(project_id=3e08162201c94003bcd1bfda733b4fdc, user_id=1f7211cec2b84394b2a5f0d2d69692c9, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:03.188968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8dc4e-eff4-4b5a-8c94-63664eb2e1ad None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:03.215986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 42/85] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:02 2022] PUT /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/1f7211cec2b84394b2a5f0d2d69692c9/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:03.373181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372c9ce2-622e-4b64-af39-9a9ce65bc882 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:03.442519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01da4-6004-44d2-b3ce-60b8ed20cce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:03.443574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01da4-6004-44d2-b3ce-60b8ed20cce7 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:03.444005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01da4-6004-44d2-b3ce-60b8ed20cce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:03.444427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01da4-6004-44d2-b3ce-60b8ed20cce7 None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/b9dddedf69f943debb0792966846ece1/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:03.447806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b01da4-6004-44d2-b3ce-60b8ed20cce7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3e08162201c94003bcd1bfda733b4fdc, user_id=b9dddedf69f943debb0792966846ece1, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:03.450552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b01da4-6004-44d2-b3ce-60b8ed20cce7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:03.477184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 44/86] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:03 2022] PUT /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/b9dddedf69f943debb0792966846ece1/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:04.738607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127e476-b0bd-446d-895e-a8a24b1a5b1a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:04.739203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127e476-b0bd-446d-895e-a8a24b1a5b1a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:04.739203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127e476-b0bd-446d-895e-a8a24b1a5b1a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:04.740625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 43/87] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:04.747220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb9e4-4786-4f69-88d1-b2d8cd5e23bc None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:04.747794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb9e4-4786-4f69-88d1-b2d8cd5e23bc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:04.748007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fb9e4-4786-4f69-88d1-b2d8cd5e23bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:04.768735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-670fb9e4-4786-4f69-88d1-b2d8cd5e23bc None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:04.770444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-670fb9e4-4786-4f69-88d1-b2d8cd5e23bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:04.850033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:04.868698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 45/88] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:05.358296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127e476-b0bd-446d-895e-a8a24b1a5b1a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:05.508740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:05.587951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127e476-b0bd-446d-895e-a8a24b1a5b1a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:05.654701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:05.655690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:05.656225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:05.656675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:05.678177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:05.688109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:05.689856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:05.691230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 44/89] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:05.701676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fb9e4-4786-4f69-88d1-b2d8cd5e23bc None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:05.874120 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fb9e4-4786-4f69-88d1-b2d8cd5e23bc None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:05.915535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:05.916071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:05.916358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:05.916633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:05.917327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:05.917668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:05.919128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:05.929155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 46/90] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:05.935540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:06.064006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd499af-400a-471c-a021-4ca437b52669 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:06.108666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:06.115734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:06.116870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:06.117599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:06.117884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] PATH_INFO: `/v3/users/1f7211cec2b84394b2a5f0d2d69692c9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:06.119236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] RBAC: Authorizing `identity:get_user(user_id=1f7211cec2b84394b2a5f0d2d69692c9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:06.121272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:06.123690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 45/91] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:05 2022] GET /identity/v3/users/1f7211cec2b84394b2a5f0d2d69692c9 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:06.130069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:06.210526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:06.333331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed748270-4e72-4499-ae9e-4af105a51d7d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:06.425012 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:06.426160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:06.426632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:06.427107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:06.600134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:06.603447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:06.728799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:06.842519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 47/92] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:43:06.852730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:07.098430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edc3dd-24af-4432-be8f-87b888bf86cd None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:07.178973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97065ea9-39a1-45d3-b6d4-a149a9cf69d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:07.179974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065ea9-39a1-45d3-b6d4-a149a9cf69d8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.180465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065ea9-39a1-45d3-b6d4-a149a9cf69d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.180949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97065ea9-39a1-45d3-b6d4-a149a9cf69d8 None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.183106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97065ea9-39a1-45d3-b6d4-a149a9cf69d8 None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:07.186005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97065ea9-39a1-45d3-b6d4-a149a9cf69d8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:07.189222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 46/93] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:06 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:07.198749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:07.218132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed2f3-207e-4aff-a35d-65990b19ec3c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.218472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed2f3-207e-4aff-a35d-65990b19ec3c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.218873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed2f3-207e-4aff-a35d-65990b19ec3c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.220603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 47/94] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:07.231337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41bcb-cee9-442f-bf9e-057a5fa3a44a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.231663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41bcb-cee9-442f-bf9e-057a5fa3a44a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.231882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d41bcb-cee9-442f-bf9e-057a5fa3a44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.285849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c7d41bcb-cee9-442f-bf9e-057a5fa3a44a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:07.287964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c7d41bcb-cee9-442f-bf9e-057a5fa3a44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:07.438024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:07.458519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9f3b0-18f9-4b5b-aa61-593c768167aa None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:07.465847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 48/95] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:07.526167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0c4b1-94f1-4a44-bc3f-8ffecb1a57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:07.526938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c4b1-94f1-4a44-bc3f-8ffecb1a57f9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.527244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c4b1-94f1-4a44-bc3f-8ffecb1a57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.527521 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c4b1-94f1-4a44-bc3f-8ffecb1a57f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.528353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0c4b1-94f1-4a44-bc3f-8ffecb1a57f9 None admin] RBAC: Adding query filter params (role.id=3b63b6b8ba3a43158d1be9fe4d2322d5, scope.project.id=3e08162201c94003bcd1bfda733b4fdc, user.id=1f7211cec2b84394b2a5f0d2d69692c9) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:07.528665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0c4b1-94f1-4a44-bc3f-8ffecb1a57f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:07.530228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0c4b1-94f1-4a44-bc3f-8ffecb1a57f9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:07.543196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 48/96] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:07 2022] GET /identity/v3/role_assignments?user.id=1f7211cec2b84394b2a5f0d2d69692c9&scope.project.id=3e08162201c94003bcd1bfda733b4fdc&role.id=3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:07.638116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7502-97cd-4b23-b60a-675442ad149e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.638469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7502-97cd-4b23-b60a-675442ad149e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.638740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7502-97cd-4b23-b60a-675442ad149e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.640355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 49/97] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:07.654255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5259a2-bc76-483f-a7a2-d67beaa73511 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.654658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5259a2-bc76-483f-a7a2-d67beaa73511 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.654859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5259a2-bc76-483f-a7a2-d67beaa73511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.682816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5e5259a2-bc76-483f-a7a2-d67beaa73511 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:07.684103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5e5259a2-bc76-483f-a7a2-d67beaa73511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:07.693458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:07.783948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 49/98] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:07.921046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7502-97cd-4b23-b60a-675442ad149e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:07.942097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fc47f-96af-4974-a7fa-cd407c077e54 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.942427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fc47f-96af-4974-a7fa-cd407c077e54 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.942667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fc47f-96af-4974-a7fa-cd407c077e54 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:07.944532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 50/99] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:07.953540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5df8c8-d896-4d4c-ab62-3ab3d614002f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:07.954048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5df8c8-d896-4d4c-ab62-3ab3d614002f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:07.954540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5df8c8-d896-4d4c-ab62-3ab3d614002f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.000175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3d5df8c8-d896-4d4c-ab62-3ab3d614002f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:08.003624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3d5df8c8-d896-4d4c-ab62-3ab3d614002f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:08.145512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7502-97cd-4b23-b60a-675442ad149e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:08.167979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 51/100] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:08.225536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feddcf5-bf13-4f8e-81fa-7c244a5803e3 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:08.226995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feddcf5-bf13-4f8e-81fa-7c244a5803e3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:08.227491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feddcf5-bf13-4f8e-81fa-7c244a5803e3 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.227592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:08.228658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:08.229154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:08.229690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.234602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 52/101] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:08.236808 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4653-826b-4465-9527-40616894a096 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:08.237366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4653-826b-4465-9527-40616894a096 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:08.237963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff4653-826b-4465-9527-40616894a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.252797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:08.258935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-baff4653-826b-4465-9527-40616894a096 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:08.260480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-baff4653-826b-4465-9527-40616894a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:08.262083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:08.262965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:08.263700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:08.264430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 50/102] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:08.272337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:08.361537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 53/103] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:08.363057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4653-826b-4465-9527-40616894a096 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:08.366063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:08.401964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:08.502328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52ddde-fcd2-4bc3-b8ef-2a77a7ff9c12 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:08.549639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff4653-826b-4465-9527-40616894a096 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:08.574133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:08.575082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:08.575772 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:08.576204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.591142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:08.592325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:08.592791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:08.593283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.594266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:08.594812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:08.596495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:08.599792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:08.607171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 54/104] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:08.608531 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:08.609787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:08.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:08.611379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:08.612607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 51/105] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:08.621025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:08.696005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:08.743762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d03f270-5222-458d-8fbb-f8afdb30d90f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:08.785208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:08.786337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:08.787138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:08.787633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.801193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:08.807392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:08.808306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:08.809048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:08.809634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7f39c-e24c-42cf-ab05-790955ffb528 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:08.811503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 55/106] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:08.812876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:08.861522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:08.871147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:08.872150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:08.872613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:08.873078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] PATH_INFO: `/v3/users/1f7211cec2b84394b2a5f0d2d69692c9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:08.874835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] RBAC: Authorizing `identity:get_user(user_id=1f7211cec2b84394b2a5f0d2d69692c9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:08.877482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:08.879822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 52/107] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:08 2022] GET /identity/v3/users/1f7211cec2b84394b2a5f0d2d69692c9 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:08.880728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:08.979748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2020d17-11e5-4b13-a31b-c5c115be7a59 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.016678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:09.037041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.037930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.038388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.038825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.039804 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:09.040296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:09.042391 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:09.058039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 56/108] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:09.059288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.073133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b66861-aa9a-4de1-970d-cf9bade37e1f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.113407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.114069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.114379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.114673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.115381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:09.115685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:09.117184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:09.126789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 53/109] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:09.127673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.182872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a01f3-c1c3-4926-9c5c-6abca78ad86a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.184405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:09.223517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b6b75-46a9-4463-836f-27b3cb00fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.224342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b6b75-46a9-4463-836f-27b3cb00fbbe None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.224694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b6b75-46a9-4463-836f-27b3cb00fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.225063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b6b75-46a9-4463-836f-27b3cb00fbbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.246849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0c539-ccc4-44a6-9d84-d432489a481b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.304723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.305778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.306120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.306488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.311025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:09.326621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:09.334361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b6b75-46a9-4463-836f-27b3cb00fbbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:09.336622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:09.337829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:09.338853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:09.339968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b6b75-46a9-4463-836f-27b3cb00fbbe None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:09.340090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 54/110] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:09.340090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.477795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 57/111] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:09.479579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0f26-ef8b-413b-80d1-dbd18740c1f9 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.479941 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0f26-ef8b-413b-80d1-dbd18740c1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.480281 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec0f26-ef8b-413b-80d1-dbd18740c1f9 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.481943 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 58/112] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:09.486985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0f26-ef8b-413b-80d1-dbd18740c1f9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.498487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c88575-e80d-4b9e-9ded-93f773767ddf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.507849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:09.548287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.549289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.549782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.550295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] PATH_INFO: `/v3/users/b9dddedf69f943debb0792966846ece1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.552170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] RBAC: Authorizing `identity:get_user(user_id=b9dddedf69f943debb0792966846ece1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:09.554799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:09.557434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 55/113] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/users/b9dddedf69f943debb0792966846ece1 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:09.558749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.619503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:09.642664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec0f26-ef8b-413b-80d1-dbd18740c1f9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.700273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.701067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.701530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.701979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] PATH_INFO: `/v3/users/1f7211cec2b84394b2a5f0d2d69692c9` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.703466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] RBAC: Authorizing `identity:get_user(user_id=1f7211cec2b84394b2a5f0d2d69692c9)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:09.705333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:09.714787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 59/114] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/users/1f7211cec2b84394b2a5f0d2d69692c9 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:09.714787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.720078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c582-a527-4159-b419-1d5ee2aad13d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.773261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1995-1cc7-4231-a2d8-ff117b0628b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.774551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1995-1cc7-4231-a2d8-ff117b0628b8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.775013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1995-1cc7-4231-a2d8-ff117b0628b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.775424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1995-1cc7-4231-a2d8-ff117b0628b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.776430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1995-1cc7-4231-a2d8-ff117b0628b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:09.776854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1995-1cc7-4231-a2d8-ff117b0628b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:09.778559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1995-1cc7-4231-a2d8-ff117b0628b8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:09.790548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 56/115] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:09.792694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205992-2111-436e-9467-d5fc65db909f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.793149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205992-2111-436e-9467-d5fc65db909f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.793629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d205992-2111-436e-9467-d5fc65db909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.820831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4d205992-2111-436e-9467-d5fc65db909f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:09.822652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4d205992-2111-436e-9467-d5fc65db909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:09.871589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:09.872129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570aab9c-b09d-439d-8d94-342da907ab5e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:09.924596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:09.925764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:09.926216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:09.926679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] PATH_INFO: `/v3/projects/95f37fa82291498cbf8b5b8c00665906` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:09.928476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] RBAC: Authorizing `identity:get_project(project_id=95f37fa82291498cbf8b5b8c00665906)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:09.929539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 57/116] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:09.930891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d205992-2111-436e-9467-d5fc65db909f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.931068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:09.937825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 60/117] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/projects/95f37fa82291498cbf8b5b8c00665906 => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:09.939202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:09.981895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:10.081224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d205992-2111-436e-9467-d5fc65db909f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.119289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90194623-1eb2-497c-a4d1-53b4ff4284e8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.144192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.145056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.145503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.145941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.185019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.186240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.186719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.187195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.190204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:10.256702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.259340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.303034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.305429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.346276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:10.426653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 58/118] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:10.427724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.457273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 61/119] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:10.460087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.517800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:10.570951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5081ba2-0af5-473a-a0ce-8859666cba4b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.599839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e14d-0a54-41b4-8998-3a21d433b1e2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.618677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.619696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.620142 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.620578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] PATH_INFO: `/v3/users/7f65fb9889844427afa3270f09011644` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.635288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:10.643249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] RBAC: Authorizing `identity:get_user(user_id=7f65fb9889844427afa3270f09011644)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.645279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.647739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 59/120] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/users/7f65fb9889844427afa3270f09011644 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:10.649347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.657968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.658941 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.659408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.659981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.661275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] RBAC: Adding query filter params (role.id=1df8c96377614e95b2f2fa089b4631f4, scope.project.id=95f37fa82291498cbf8b5b8c00665906, user.id=1f7211cec2b84394b2a5f0d2d69692c9) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:10.661809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.664401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.672773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 62/121] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/role_assignments?user.id=1f7211cec2b84394b2a5f0d2d69692c9&scope.project.id=95f37fa82291498cbf8b5b8c00665906&role.id=1df8c96377614e95b2f2fa089b4631f4 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:10.673929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.801695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634f694-7b0a-4bde-9e85-814c34fd68a9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.828576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d00c7-3201-44e3-94e3-069ac5395609 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:10.846053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.847161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.847677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.848272 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.849720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.851442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.853562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 63/122] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:10.854428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.883521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:10.898465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:10.899510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:10.900240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:10.900240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:10.901428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:10.902874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:10.904572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 60/123] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:10.906735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:10.949368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:11.004829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096effc4-014e-4914-bf78-b5ba2789a811 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:11.031981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083faf27-5ed7-4c3a-a750-74a2d046c423 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:11.046008 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:11.046669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:11.046952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:11.047230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:11.048436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:11.050076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:11.051871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 64/124] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:11.052685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:11.070291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:11.070950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:11.071236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:11.071514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:11.072692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:11.074241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:11.076001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 61/125] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:10 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:11.076792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:11.144534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:11.171807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27abdffa-36ad-4cf7-9d93-5aa80ce4260b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:11.193942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f251b-979d-4a04-af68-5fb942c42144 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:11.199736 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:11.213702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:11.214601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:11.214959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:11.215333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:11.216184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=3e08162201c94003bcd1bfda733b4fdc, user.id=b9dddedf69f943debb0792966846ece1) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:11.216583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:11.218613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:11.226468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 65/126] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:11 2022] GET /identity/v3/role_assignments?user.id=b9dddedf69f943debb0792966846ece1&scope.project.id=3e08162201c94003bcd1bfda733b4fdc&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:11.227943 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:11.245030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:11.246001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:11.246678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:11.246813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:11.247531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:11.249469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:11.284783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 62/127] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:43:11 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:43:11.285699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:11.416806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e260609-e1bc-4140-a283-056b51a8cf62 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:11.425042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec052e-c110-43d8-a768-25f443355179 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:11.444486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:11.476095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f30863-c59b-4469-8cc4-494a7ca225ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:11.477260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30863-c59b-4469-8cc4-494a7ca225ca None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:11.477825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30863-c59b-4469-8cc4-494a7ca225ca None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:11.478270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f30863-c59b-4469-8cc4-494a7ca225ca None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/7f65fb9889844427afa3270f09011644/roles/87d93189b26b492587f44cb444bd25c7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:11.480845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f30863-c59b-4469-8cc4-494a7ca225ca None admin] RBAC: Authorizing `identity:create_grant(project_id=3e08162201c94003bcd1bfda733b4fdc, user_id=7f65fb9889844427afa3270f09011644, role_id=87d93189b26b492587f44cb444bd25c7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:11.483012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f30863-c59b-4469-8cc4-494a7ca225ca None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:11.488730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c519-8e76-4265-8bda-24f3cabbc058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:11.489855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c519-8e76-4265-8bda-24f3cabbc058 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:11.490322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c519-8e76-4265-8bda-24f3cabbc058 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:11.490889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c519-8e76-4265-8bda-24f3cabbc058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:11.492203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c519-8e76-4265-8bda-24f3cabbc058 None admin] RBAC: Adding query filter params (role.id=1df8c96377614e95b2f2fa089b4631f4, scope.project.id=3e08162201c94003bcd1bfda733b4fdc, user.id=1f7211cec2b84394b2a5f0d2d69692c9) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:11.492718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c519-8e76-4265-8bda-24f3cabbc058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:11.495363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c519-8e76-4265-8bda-24f3cabbc058 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:11.502016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 63/128] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:11 2022] PUT /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc/users/7f65fb9889844427afa3270f09011644/roles/87d93189b26b492587f44cb444bd25c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:11.506970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 66/129] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:11 2022] GET /identity/v3/role_assignments?user.id=1f7211cec2b84394b2a5f0d2d69692c9&scope.project.id=3e08162201c94003bcd1bfda733b4fdc&role.id=1df8c96377614e95b2f2fa089b4631f4 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:14.884750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e0630-de1f-4f48-9e84-ecd0ae6d9438 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:14.885590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e0630-de1f-4f48-9e84-ecd0ae6d9438 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:14.885734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e0630-de1f-4f48-9e84-ecd0ae6d9438 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:14.887741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 64/130] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:14.893651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63441f68-df35-4019-8397-24dce6305f5c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:14.894510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63441f68-df35-4019-8397-24dce6305f5c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:14.894510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63441f68-df35-4019-8397-24dce6305f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:14.916815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-63441f68-df35-4019-8397-24dce6305f5c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:14.918137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-63441f68-df35-4019-8397-24dce6305f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:14.970183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154de9c5-823b-4593-a3ad-d780da6badc0 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:14.970610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154de9c5-823b-4593-a3ad-d780da6badc0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:14.970949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154de9c5-823b-4593-a3ad-d780da6badc0 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:14.973005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 65/131] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:14.981355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc0d5-1f6e-4d48-811d-77d9523e8eb0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:14.981831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc0d5-1f6e-4d48-811d-77d9523e8eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:14.982258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccc0d5-1f6e-4d48-811d-77d9523e8eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:14.984889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:15.009819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-47ccc0d5-1f6e-4d48-811d-77d9523e8eb0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:15.011725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-47ccc0d5-1f6e-4d48-811d-77d9523e8eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:15.021869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 67/132] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:15.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 66/133] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:15.305085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63441f68-df35-4019-8397-24dce6305f5c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:15.369425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccc0d5-1f6e-4d48-811d-77d9523e8eb0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:15.430961 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63441f68-df35-4019-8397-24dce6305f5c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:15.491472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:15.492517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:15.492999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:15.493592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:15.495468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:15.496367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccc0d5-1f6e-4d48-811d-77d9523e8eb0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:15.497413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:15.498045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:15.499472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 68/134] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:15.507147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:15.552360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:15.553480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:15.553967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:15.554469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:15.570551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:15.575022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:15.585169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:15.586204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:15.587132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:15.588152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 67/135] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:15.593686 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:15.640057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e30715-93e5-4a4c-ab53-4d3f53283002 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:15.684886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:15.685712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:15.686543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:15.686543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:15.687134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:15.689019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:15.718439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 69/136] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:43:15 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:43:15.724466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796b487d-2651-476e-8c55-1e87c9b412a2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:15.770310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:15.771044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:15.771389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:15.771730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:15.772519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:15.772888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:15.774892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:15.786140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 68/137] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:15.792569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:15.949780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68f00b-6efe-4f46-b389-3bbde7846123 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:15.954482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:16.005150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:16.006050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:16.006545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:16.006992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] PATH_INFO: `/v3/users/7f65fb9889844427afa3270f09011644` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:16.008705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] RBAC: Authorizing `identity:get_user(user_id=7f65fb9889844427afa3270f09011644)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:16.010395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:16.012582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 70/138] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:15 2022] GET /identity/v3/users/7f65fb9889844427afa3270f09011644 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:16.019950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:16.066381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:16.197067 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becbcf80-1711-4bc4-97eb-5aff4618de38 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:16.262508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:16.263444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:16.263924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:16.264411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:16.379229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:16.380758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:16.412085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:16.552406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 69/139] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:43:16.561803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:16.738534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcb73f-2b4f-440b-8cd7-eca481cafbe1 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:16.798463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374f2ab-378c-4070-bd71-c22565857f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:16.799460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374f2ab-378c-4070-bd71-c22565857f5b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:16.799972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374f2ab-378c-4070-bd71-c22565857f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:16.800528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374f2ab-378c-4070-bd71-c22565857f5b None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:16.802478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374f2ab-378c-4070-bd71-c22565857f5b None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:16.804956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374f2ab-378c-4070-bd71-c22565857f5b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:16.807834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 71/140] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:16 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:16.818497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:17.021646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af64fe-a904-4268-b189-abac1ce59a38 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:17.070504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:17.090825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825a54b-0d51-4344-b955-3ee1407d591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:17.091861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a54b-0d51-4344-b955-3ee1407d591f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:17.092347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a54b-0d51-4344-b955-3ee1407d591f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:17.092823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825a54b-0d51-4344-b955-3ee1407d591f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:17.094236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825a54b-0d51-4344-b955-3ee1407d591f None admin] RBAC: Adding query filter params (role.id=87d93189b26b492587f44cb444bd25c7, scope.project.id=3e08162201c94003bcd1bfda733b4fdc, user.id=7f65fb9889844427afa3270f09011644) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:17.094761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825a54b-0d51-4344-b955-3ee1407d591f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:17.097577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825a54b-0d51-4344-b955-3ee1407d591f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:17.117743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 70/141] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:16 2022] GET /identity/v3/role_assignments?user.id=7f65fb9889844427afa3270f09011644&scope.project.id=3e08162201c94003bcd1bfda733b4fdc&role.id=87d93189b26b492587f44cb444bd25c7 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:18.383321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7c48-ee94-4ba9-bae4-7333b8c0edcc None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:18.384021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7c48-ee94-4ba9-bae4-7333b8c0edcc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:18.384021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb7c48-ee94-4ba9-bae4-7333b8c0edcc None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:18.385361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 72/142] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:18.391540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4429f5c-16e9-4a01-88c4-99fa81ba7e21 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:18.392238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4429f5c-16e9-4a01-88c4-99fa81ba7e21 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:18.392238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4429f5c-16e9-4a01-88c4-99fa81ba7e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:18.412559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b4429f5c-16e9-4a01-88c4-99fa81ba7e21 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:18.413871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b4429f5c-16e9-4a01-88c4-99fa81ba7e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:18.500859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 71/143] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:18.573552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070b565-e4eb-4c75-8421-80a6002b1db6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:18.574149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070b565-e4eb-4c75-8421-80a6002b1db6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:18.574729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070b565-e4eb-4c75-8421-80a6002b1db6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:18.577099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 73/144] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:18.583202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f1bd-bad8-465a-ace0-11a63a0a374e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:18.583568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f1bd-bad8-465a-ace0-11a63a0a374e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:18.583773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6f1bd-bad8-465a-ace0-11a63a0a374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:18.604316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d6c6f1bd-bad8-465a-ace0-11a63a0a374e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:18.605559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d6c6f1bd-bad8-465a-ace0-11a63a0a374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:18.695266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 72/145] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:18.769883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070b565-e4eb-4c75-8421-80a6002b1db6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:18.824536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:18.906166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070b565-e4eb-4c75-8421-80a6002b1db6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:18.947013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:18.947542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:18.947822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:18.948096 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:18.961684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:18.967194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:18.968867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:18.970599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 74/146] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:43:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:18.974638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6f1bd-bad8-465a-ace0-11a63a0a374e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:19.042055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:19.094390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:19.133577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6f1bd-bad8-465a-ace0-11a63a0a374e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:19.186906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:19.187537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:19.188556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:19.188556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:19.188829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:19.189104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:19.190546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:19.209594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 73/147] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:19.212521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:19.270115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:19.275920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4f5e8-f139-409b-b7f0-e66725ee282a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:19.326884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80308088-aa69-45d4-906b-86ae0e27c39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:19.327899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308088-aa69-45d4-906b-86ae0e27c39b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:19.328337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308088-aa69-45d4-906b-86ae0e27c39b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:19.328753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308088-aa69-45d4-906b-86ae0e27c39b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:19.330819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80308088-aa69-45d4-906b-86ae0e27c39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:19.333429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80308088-aa69-45d4-906b-86ae0e27c39b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:19.336077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 75/148] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:19.338207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5d84-5fda-4578-b54f-2ec4533c2813 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:19.338553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5d84-5fda-4578-b54f-2ec4533c2813 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:19.338868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca5d84-5fda-4578-b54f-2ec4533c2813 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:19.341435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 76/149] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:19.343202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca5d84-5fda-4578-b54f-2ec4533c2813 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:19.372242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e1da4-f6b8-4874-9521-f8453e928d5d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:19.386370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:19.417944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96793b62-f031-47ea-a43c-f9b33700f32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:19.418797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793b62-f031-47ea-a43c-f9b33700f32f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:19.418898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793b62-f031-47ea-a43c-f9b33700f32f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:19.419261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96793b62-f031-47ea-a43c-f9b33700f32f None admin] PATH_INFO: `/v3/users/18bf52f80d2546bfabbce0c806382ea1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:19.439558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96793b62-f031-47ea-a43c-f9b33700f32f None admin] RBAC: Authorizing `identity:get_user(user_id=18bf52f80d2546bfabbce0c806382ea1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:19.441327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96793b62-f031-47ea-a43c-f9b33700f32f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:19.443383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 74/150] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:19 2022] GET /identity/v3/users/18bf52f80d2546bfabbce0c806382ea1 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:19.445144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c69a-92b7-4697-b059-014694cae132 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:19.445404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c69a-92b7-4697-b059-014694cae132 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:19.445808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8c69a-92b7-4697-b059-014694cae132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:19.467414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b8b8c69a-92b7-4697-b059-014694cae132 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:19.468805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b8b8c69a-92b7-4697-b059-014694cae132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:19.484345 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca5d84-5fda-4578-b54f-2ec4533c2813 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:19.527635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:19.528541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:19.528995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:19.529515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:19.530320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:19.532127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:19.558057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 77/151] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:43:19 2022] POST /identity/v3/users => generated 297 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:43:19.558931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:19.562720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 75/152] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:19.612312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:19.764472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf559-dbb3-46d2-b00e-6e134ac775c6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:19.831527 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:19.832504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:19.832851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:19.833180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:19.835111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:19.836460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c69a-92b7-4697-b059-014694cae132 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:19.836999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:19.841924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 78/153] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:19 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:19.849278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:20.013323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:20.028032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:20.028431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0d5e2-9f50-464d-941e-15acf22424ca None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:20.037554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8c69a-92b7-4697-b059-014694cae132 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:20.092942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:20.093509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:20.093938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:20.094362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/18bf52f80d2546bfabbce0c806382ea1/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:20.099246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] RBAC: Authorizing `identity:create_grant(project_id=770e1d8530dc4e2999324d107c6c436c, user_id=18bf52f80d2546bfabbce0c806382ea1, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:20.101045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:20.124429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:20.124429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:20.124429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:20.124429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:20.125024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 79/154] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:19 2022] PUT /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/18bf52f80d2546bfabbce0c806382ea1/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:43:20.151939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:20.161947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:20.163507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:20.164845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 76/155] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:43:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:20.171269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:20.387275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d91c8-dbc6-41eb-ad74-e5aef655898d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:20.453153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:20.454150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:20.454608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:20.455058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:20.456368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:20.456904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:20.459564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:20.475887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 80/156] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:43:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:20.485721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:20.628536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3cb18-e462-416d-8ab9-e91f0bcaf88a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:20.698912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:20.700392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:20.701109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:20.701866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] PATH_INFO: `/v3/users/18bf52f80d2546bfabbce0c806382ea1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:20.704240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] RBAC: Authorizing `identity:get_user(user_id=18bf52f80d2546bfabbce0c806382ea1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:20.707329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:20.711547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 77/157] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:20 2022] GET /identity/v3/users/18bf52f80d2546bfabbce0c806382ea1 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:20.721102 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:20.762244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:20.881052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5a7f0-6120-4068-a182-4ec0be0d3189 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:20.923193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b34da-e0da-422b-980c-fc87adf39aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:20.923868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b34da-e0da-422b-980c-fc87adf39aca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:20.924140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b34da-e0da-422b-980c-fc87adf39aca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:20.924405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b34da-e0da-422b-980c-fc87adf39aca None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:20.925990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b34da-e0da-422b-980c-fc87adf39aca None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:20.927530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b34da-e0da-422b-980c-fc87adf39aca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:20.933618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 81/158] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:20 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:20.936625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:20.984239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:21.111886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476597a1-0794-4904-b243-93efaa53a85d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:21.180760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745882e-c648-407e-a371-b62773bcbacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:21.182395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745882e-c648-407e-a371-b62773bcbacb None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:21.183108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745882e-c648-407e-a371-b62773bcbacb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:21.183806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745882e-c648-407e-a371-b62773bcbacb None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/18bf52f80d2546bfabbce0c806382ea1/roles/3b63b6b8ba3a43158d1be9fe4d2322d5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:21.188031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745882e-c648-407e-a371-b62773bcbacb None admin] RBAC: Authorizing `identity:create_grant(project_id=770e1d8530dc4e2999324d107c6c436c, user_id=18bf52f80d2546bfabbce0c806382ea1, role_id=3b63b6b8ba3a43158d1be9fe4d2322d5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:21.191394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745882e-c648-407e-a371-b62773bcbacb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:21.217084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 78/159] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:20 2022] PUT /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/18bf52f80d2546bfabbce0c806382ea1/roles/3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:43:22.461049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726267-28ed-4146-9dc2-4a7ccc780791 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:22.461630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726267-28ed-4146-9dc2-4a7ccc780791 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:22.462066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4726267-28ed-4146-9dc2-4a7ccc780791 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:22.464280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 82/160] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:22.470462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d803-2777-4fda-aa2a-0de28af0ddfe None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:22.471434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d803-2777-4fda-aa2a-0de28af0ddfe None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:22.472048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9d803-2777-4fda-aa2a-0de28af0ddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:22.500434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fed9d803-2777-4fda-aa2a-0de28af0ddfe None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:22.503250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fed9d803-2777-4fda-aa2a-0de28af0ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:22.637943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 79/161] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:22.996790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4726267-28ed-4146-9dc2-4a7ccc780791 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:23.097825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:23.120686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4726267-28ed-4146-9dc2-4a7ccc780791 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:23.161721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:23.162393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:23.162672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:23.162940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:23.164219 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:23.165760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:23.167795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 83/162] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:23.173179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b6cb8-5abd-4774-ae6a-03e542cb8fa4 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:23.173881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b6cb8-5abd-4774-ae6a-03e542cb8fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:23.174462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b6cb8-5abd-4774-ae6a-03e542cb8fa4 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:23.176487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 80/163] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:23.177026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:23.184203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac481e-f284-449e-aea2-a3ba3a283b8f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:23.184686 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac481e-f284-449e-aea2-a3ba3a283b8f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:23.185533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac481e-f284-449e-aea2-a3ba3a283b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:23.217282 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b8ac481e-f284-449e-aea2-a3ba3a283b8f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:23.219931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b8ac481e-f284-449e-aea2-a3ba3a283b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:23.242048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:23.301947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5425a08-3e48-43ab-b6f1-45e1feb75586 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:23.345750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df32443-b936-4008-b018-b1245ac69790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:23.347058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32443-b936-4008-b018-b1245ac69790 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:23.347482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32443-b936-4008-b018-b1245ac69790 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:23.347953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df32443-b936-4008-b018-b1245ac69790 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:23.348783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df32443-b936-4008-b018-b1245ac69790 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:23.349853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 81/164] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:23.355032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df32443-b936-4008-b018-b1245ac69790 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:23.393603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 84/165] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:43:23 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:43:23.638508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac481e-f284-449e-aea2-a3ba3a283b8f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:23.764217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d68694-95a6-4548-a2ff-fdefa207cb8d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:23.764971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d68694-95a6-4548-a2ff-fdefa207cb8d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:23.765140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d68694-95a6-4548-a2ff-fdefa207cb8d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:23.768686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 85/166] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:23.778447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167f4c-c98e-4321-bba7-9585cbb39cf1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:23.779342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167f4c-c98e-4321-bba7-9585cbb39cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:23.780043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167f4c-c98e-4321-bba7-9585cbb39cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:23.805902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:23.819280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-82167f4c-c98e-4321-bba7-9585cbb39cf1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:23.820618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-82167f4c-c98e-4321-bba7-9585cbb39cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:23.829193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac481e-f284-449e-aea2-a3ba3a283b8f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:23.886715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:23.887377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:23.887660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:23.887933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:23.901215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:23.906356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:23.907312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:23.908093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 82/167] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:23.913976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:23.925745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:23.939340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 86/168] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:24.035807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17938a7-fc0e-45e9-b9bb-88e0d803552a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:24.074952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:24.075835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:24.076254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:24.076667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:24.077526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:24.077967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:24.079537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:24.090061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 83/169] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:24.095871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167f4c-c98e-4321-bba7-9585cbb39cf1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:24.306846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167f4c-c98e-4321-bba7-9585cbb39cf1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:24.318256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:24.368129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fa3b1-2613-4060-9c31-e85b88094361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:24.369070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fa3b1-2613-4060-9c31-e85b88094361 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:24.369536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fa3b1-2613-4060-9c31-e85b88094361 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:24.369982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fa3b1-2613-4060-9c31-e85b88094361 None admin] PATH_INFO: `/v3/users/b89162625c3d483daeb8843036615eb7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:24.373960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:24.388519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fa3b1-2613-4060-9c31-e85b88094361 None admin] RBAC: Authorizing `identity:get_user(user_id=b89162625c3d483daeb8843036615eb7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:24.390316 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fa3b1-2613-4060-9c31-e85b88094361 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:24.392250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 87/170] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:24 2022] GET /identity/v3/users/b89162625c3d483daeb8843036615eb7 => generated 297 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:24.393892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723de7-0449-4e49-8822-1f07aaf58999 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:24.394449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723de7-0449-4e49-8822-1f07aaf58999 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:24.394912 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723de7-0449-4e49-8822-1f07aaf58999 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:24.396465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 88/171] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:24.398320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5723de7-0449-4e49-8822-1f07aaf58999 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:24.448947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:24.510232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90125ba7-3d66-4c50-b4fe-00923888956a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:24.562000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a345024-f12a-4a1b-89b5-297a072f37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:24.563058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a345024-f12a-4a1b-89b5-297a072f37ac None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:24.563551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a345024-f12a-4a1b-89b5-297a072f37ac None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:24.564031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a345024-f12a-4a1b-89b5-297a072f37ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:24.578547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a345024-f12a-4a1b-89b5-297a072f37ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-8a345024-f12a-4a1b-89b5-297a072f37ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:24.585329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:24.586307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:24.587091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:24.589904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 84/172] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:43:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:24.591879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab665f0b-8783-426b-be45-dd7fb5760abf None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:24.592519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab665f0b-8783-426b-be45-dd7fb5760abf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:24.592996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab665f0b-8783-426b-be45-dd7fb5760abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:24.593161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5723de7-0449-4e49-8822-1f07aaf58999 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:24.615023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ab665f0b-8783-426b-be45-dd7fb5760abf None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:24.616656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ab665f0b-8783-426b-be45-dd7fb5760abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:24.652887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:24.654080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:24.654560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:24.655020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:24.656675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:24.658566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:24.661227 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 89/173] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:24 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:24.662745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:24.745679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:24.773843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 85/174] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:24.775825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab665f0b-8783-426b-be45-dd7fb5760abf None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:24.796777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49470c3-3ab9-468b-90f4-af5fe4c910d6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:24.839769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:24.843939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:24.844592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:24.845089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:24.846078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:24.846669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:24.849255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:24.860286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 90/175] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:24.870537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:24.901615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:24.983869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab665f0b-8783-426b-be45-dd7fb5760abf None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:25.050231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:25.051654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:25.052318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:25.052903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/b89162625c3d483daeb8843036615eb7/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:25.056181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] RBAC: Authorizing `identity:create_grant(project_id=770e1d8530dc4e2999324d107c6c436c, user_id=b89162625c3d483daeb8843036615eb7, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:25.059256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:25.090314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 86/176] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:24 2022] PUT /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/b89162625c3d483daeb8843036615eb7/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:25.171752 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbee4d-42c7-426b-8f7f-52beb9b8bc00 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:25.231485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:25.249863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:25.250513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:25.250792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:25.251059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] PATH_INFO: `/v3/users/18bf52f80d2546bfabbce0c806382ea1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:25.252386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] RBAC: Authorizing `identity:get_user(user_id=18bf52f80d2546bfabbce0c806382ea1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:25.254056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:25.255835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 91/177] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:24 2022] GET /identity/v3/users/18bf52f80d2546bfabbce0c806382ea1 => generated 283 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:25.264783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:25.312359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:25.500678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469c4aa-25f8-4164-85e7-bd02f3629ffe None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:25.513413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977c4bf-7da3-4f2c-9609-37334d4f5b50 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:25.524291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:25.549891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:25.550952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:25.551439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:25.551910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:25.557163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:25.557573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:25.557742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:25.557993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:25.570775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:25.576657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:25.577738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:25.578503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 92/178] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:43:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:25.584386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:25.639266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:25.641237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:25.645971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:25.702571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479bdae-2693-4c2e-9794-040ded2b0479 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:25.753546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:25.753546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:25.753546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:25.753546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:25.754165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:25.754165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:25.754165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:25.758624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 93/179] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:43:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:25.764689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:25.840491 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 87/180] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:25.859242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:25.920841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:25.928600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0b4c4-bd5b-4b11-a072-c2999a242492 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:25.983337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:26.067813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:26.069443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:26.071528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:26.072969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] PATH_INFO: `/v3/users/18bf52f80d2546bfabbce0c806382ea1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:26.079005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] RBAC: Authorizing `identity:get_user(user_id=18bf52f80d2546bfabbce0c806382ea1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:26.084905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:26.096103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 94/181] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:25 2022] GET /identity/v3/users/18bf52f80d2546bfabbce0c806382ea1 => generated 283 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:26.099618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:26.175020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5698f-2b44-45ac-a775-ef58d2624bc3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:26.223409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:26.224702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:26.227213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:26.227786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:26.229798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:26.232733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:26.240670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 88/182] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:25 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:26.250262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:26.363416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:26.379798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a76ec-ac62-4193-b6ee-237495c4192b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:26.385302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2f696-eb24-4dfb-8408-db46cc914f1d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:26.430504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:26.433704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:26.434112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:26.434519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:26.435704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=770e1d8530dc4e2999324d107c6c436c, user.id=18bf52f80d2546bfabbce0c806382ea1) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:26.436209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:26.439035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:26.461790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 89/183] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:26 2022] GET /identity/v3/role_assignments?user.id=18bf52f80d2546bfabbce0c806382ea1&scope.project.id=770e1d8530dc4e2999324d107c6c436c&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:26.491001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfe679-e48c-4271-934f-3407b7d8f32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:26.491951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfe679-e48c-4271-934f-3407b7d8f32d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:26.492408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfe679-e48c-4271-934f-3407b7d8f32d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:26.492830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfe679-e48c-4271-934f-3407b7d8f32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:26.599004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:26.636548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfe679-e48c-4271-934f-3407b7d8f32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:26.638489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfe679-e48c-4271-934f-3407b7d8f32d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:26.813056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 95/184] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:26.819551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:26.895156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda36f-151f-4d01-b641-460a6a8e4ecc None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:26.896417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda36f-151f-4d01-b641-460a6a8e4ecc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:26.896970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafda36f-151f-4d01-b641-460a6a8e4ecc None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:26.899573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 96/185] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:26.907550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87dd26-4255-4c3b-b440-759fe5e6b201 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:26.908184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87dd26-4255-4c3b-b440-759fe5e6b201 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:26.908681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f87dd26-4255-4c3b-b440-759fe5e6b201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:26.957570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8f87dd26-4255-4c3b-b440-759fe5e6b201 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:26.959594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8f87dd26-4255-4c3b-b440-759fe5e6b201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:27.074371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4db6a-db39-48bb-ae33-d87b5f519290 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:27.130768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 97/186] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:27.160932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:27.162065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:27.162544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:27.163034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:27.165106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:27.167868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:27.171570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 90/187] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:26 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:27.180072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87dd26-4255-4c3b-b440-759fe5e6b201 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:27.207274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:27.349284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f87dd26-4255-4c3b-b440-759fe5e6b201 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:27.389208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b59a83-e607-4bcf-ae1e-3fdd511b5640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:27.389898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59a83-e607-4bcf-ae1e-3fdd511b5640 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:27.390547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59a83-e607-4bcf-ae1e-3fdd511b5640 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:27.390822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b59a83-e607-4bcf-ae1e-3fdd511b5640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:27.391576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b59a83-e607-4bcf-ae1e-3fdd511b5640 None admin] RBAC: Adding query filter params (role.id=3b63b6b8ba3a43158d1be9fe4d2322d5, scope.project.id=770e1d8530dc4e2999324d107c6c436c, user.id=18bf52f80d2546bfabbce0c806382ea1) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:27.391885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b59a83-e607-4bcf-ae1e-3fdd511b5640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:27.393501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b59a83-e607-4bcf-ae1e-3fdd511b5640 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:27.401189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 98/188] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:27 2022] GET /identity/v3/role_assignments?user.id=18bf52f80d2546bfabbce0c806382ea1&scope.project.id=770e1d8530dc4e2999324d107c6c436c&role.id=3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:27.639802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:27.681637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:27.837501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180817d9-60b9-430a-bf3a-e848edccd0f3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:27.884341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:27.885146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:27.885283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:27.885601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:27.887649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d711-1b89-43bc-a853-c360a5446a78 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:27.888155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d711-1b89-43bc-a853-c360a5446a78 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:27.888654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5d711-1b89-43bc-a853-c360a5446a78 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:27.891397 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 99/189] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:27.900757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:27.901364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccb71e-7455-429e-8e8a-6ec2d0c4b8ab None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:27.901929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccb71e-7455-429e-8e8a-6ec2d0c4b8ab None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:27.902423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ccb71e-7455-429e-8e8a-6ec2d0c4b8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:27.907205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:27.908225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:27.909079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:27.910745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 91/190] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:27.920211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:27.932971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e3ccb71e-7455-429e-8e8a-6ec2d0c4b8ab None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:27.934273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e3ccb71e-7455-429e-8e8a-6ec2d0c4b8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:28.021234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 100/191] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:28.064315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:28.093688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc672f-de7f-4a97-a1b3-fdb766ee82f1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:28.140411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e45885-2402-4dc5-ad1e-f861a6a9b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:28.141334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45885-2402-4dc5-ad1e-f861a6a9b58b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:28.141864 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45885-2402-4dc5-ad1e-f861a6a9b58b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:28.142228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e45885-2402-4dc5-ad1e-f861a6a9b58b None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:28.143062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e45885-2402-4dc5-ad1e-f861a6a9b58b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:28.143571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e45885-2402-4dc5-ad1e-f861a6a9b58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:28.145323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e45885-2402-4dc5-ad1e-f861a6a9b58b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:28.156698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 92/192] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:28.162685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccb71e-7455-429e-8e8a-6ec2d0c4b8ab None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:28.172262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:28.290832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ccb71e-7455-429e-8e8a-6ec2d0c4b8ab None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:28.333108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:28.333802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:28.334079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:28.334355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] PATH_INFO: `/v3/users/d19276116b32439d83147e6912d1c949` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:28.350984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f529e-523f-4046-ae96-e79089e8d9d7 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:28.351367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f529e-523f-4046-ae96-e79089e8d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:28.351495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] RBAC: Authorizing `identity:get_user(user_id=d19276116b32439d83147e6912d1c949)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:28.351598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427f529e-523f-4046-ae96-e79089e8d9d7 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:28.353149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 93/193] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:28.353307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:28.355078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 101/194] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:28 2022] GET /identity/v3/users/d19276116b32439d83147e6912d1c949 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:28.358733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ea1d-4535-471b-b031-ff014ad9b837 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:28.359017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ea1d-4535-471b-b031-ff014ad9b837 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:28.359504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ea1d-4535-471b-b031-ff014ad9b837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:28.360421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:28.386753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-09a1ea1d-4535-471b-b031-ff014ad9b837 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:28.388019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-09a1ea1d-4535-471b-b031-ff014ad9b837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:28.448922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:28.474896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 94/195] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:28.518360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8abe8a-1b96-46cb-ac3d-2a7e670bf9f3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:28.529050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ea1d-4535-471b-b031-ff014ad9b837 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:28.564953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:28.566063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:28.566505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:28.566911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:28.568533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:28.570403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:28.572754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 102/196] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:28 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:28.579798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:28.665304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:28.726818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ea1d-4535-471b-b031-ff014ad9b837 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:28.732187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ddeba-478a-4be1-91a1-e27c8c420ed4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:28.770899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:28.776736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:28.777419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:28.777698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:28.777972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:28.779113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:28.779254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:28.780423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:28.780601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:28.780998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:28.781544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/d19276116b32439d83147e6912d1c949/roles/87d93189b26b492587f44cb444bd25c7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:28.782279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 95/197] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:28.785274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] RBAC: Authorizing `identity:create_grant(project_id=770e1d8530dc4e2999324d107c6c436c, user_id=d19276116b32439d83147e6912d1c949, role_id=87d93189b26b492587f44cb444bd25c7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:28.786418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:28.788362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:28.809661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 103/198] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:43:28 2022] PUT /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c/users/d19276116b32439d83147e6912d1c949/roles/87d93189b26b492587f44cb444bd25c7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:43:28.814578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:28.951743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562fbc4-733b-42e9-a778-7b0c6c304e26 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:28.965711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e841a0-b13f-42fe-ae60-2e19b40b354e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:29.019313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:29.020712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:29.021368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:29.022039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:29.024425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:29.025468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:29.025992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:29.026300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:29.027468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:29.029939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:29.037182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:29.047180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:29.057399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:29.059219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:29.060844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:29.062758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 104/199] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:43:28 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:43:29.064436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 96/200] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:29.075394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:29.164166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:29.267712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39844b-04c6-4c4f-a939-e33edf823d6b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:29.334250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99321010-f524-4799-b7d9-f10861945488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:29.334985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99321010-f524-4799-b7d9-f10861945488 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:29.335418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99321010-f524-4799-b7d9-f10861945488 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:29.335874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99321010-f524-4799-b7d9-f10861945488 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:29.337031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99321010-f524-4799-b7d9-f10861945488 None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:29.337581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99321010-f524-4799-b7d9-f10861945488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:29.339828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99321010-f524-4799-b7d9-f10861945488 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:29.353616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 105/201] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:29.363131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:29.557373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cb2b2-93f2-402f-b2a6-8cddbf2c9d18 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:29.623381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:29.624357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:29.624829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:29.625277 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] PATH_INFO: `/v3/users/b89162625c3d483daeb8843036615eb7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:29.627430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] RBAC: Authorizing `identity:get_user(user_id=b89162625c3d483daeb8843036615eb7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:29.630355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:29.633968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 97/202] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:29 2022] GET /identity/v3/users/b89162625c3d483daeb8843036615eb7 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:29.639711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99321010-f524-4799-b7d9-f10861945488 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:29.853419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99321010-f524-4799-b7d9-f10861945488 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:29.890499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:29.918177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:29.919428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:29.919921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:29.920400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:30.056965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:30.059546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:30.249399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 106/203] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:30.255284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:30.333679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:30.376719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871cbb3-e623-4826-92b2-d3ec9f296022 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:30.417147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e268ea-250d-405d-8a24-79bbafbdc426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:30.417839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e268ea-250d-405d-8a24-79bbafbdc426 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:30.418309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e268ea-250d-405d-8a24-79bbafbdc426 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:30.418586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e268ea-250d-405d-8a24-79bbafbdc426 None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:30.419845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e268ea-250d-405d-8a24-79bbafbdc426 None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:30.421368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e268ea-250d-405d-8a24-79bbafbdc426 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:30.423513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 98/204] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:30 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:30.430156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:30.444435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:30.585924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe74f55-3319-4998-b9e8-6188f4ae869b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:30.652238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47c174-6be1-499d-901d-66628bc4bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:30.654124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c174-6be1-499d-901d-66628bc4bd39 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:30.654877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c174-6be1-499d-901d-66628bc4bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:30.655677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47c174-6be1-499d-901d-66628bc4bd39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:30.657311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c174-6be1-499d-901d-66628bc4bd39 None admin] RBAC: Adding query filter params (role.id=1df8c96377614e95b2f2fa089b4631f4, scope.project.id=770e1d8530dc4e2999324d107c6c436c, user.id=b89162625c3d483daeb8843036615eb7) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:30.658598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c174-6be1-499d-901d-66628bc4bd39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:30.661350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47c174-6be1-499d-901d-66628bc4bd39 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:30.673138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 107/205] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:30 2022] GET /identity/v3/role_assignments?user.id=b89162625c3d483daeb8843036615eb7&scope.project.id=770e1d8530dc4e2999324d107c6c436c&role.id=1df8c96377614e95b2f2fa089b4631f4 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:31.770888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6489c-6335-4d33-abfc-f9bc82e15f75 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:31.771753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6489c-6335-4d33-abfc-f9bc82e15f75 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:31.771753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6489c-6335-4d33-abfc-f9bc82e15f75 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:31.774423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 99/206] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:31.780783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365002-e284-41c9-b493-0fd0d587f0fb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:31.781647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365002-e284-41c9-b493-0fd0d587f0fb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:31.781816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07365002-e284-41c9-b493-0fd0d587f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:31.803047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-07365002-e284-41c9-b493-0fd0d587f0fb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:31.804533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-07365002-e284-41c9-b493-0fd0d587f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:31.935553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 108/207] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:32.246607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0042f-1756-498b-9dac-247d578a7b86 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:32.246888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0042f-1756-498b-9dac-247d578a7b86 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:32.247191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec0042f-1756-498b-9dac-247d578a7b86 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:32.248540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 100/208] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:32.254846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c044-865f-48a0-89d0-241dd5b996f6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:32.255235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c044-865f-48a0-89d0-241dd5b996f6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:32.255410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729c044-865f-48a0-89d0-241dd5b996f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:32.263371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:32.278800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0729c044-865f-48a0-89d0-241dd5b996f6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:32.280053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0729c044-865f-48a0-89d0-241dd5b996f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:32.362043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 109/209] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:32.421735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0042f-1756-498b-9dac-247d578a7b86 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:32.633761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec0042f-1756-498b-9dac-247d578a7b86 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:32.671022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c044-865f-48a0-89d0-241dd5b996f6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:32.703170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:32.704120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:32.704533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:32.704941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:32.708455 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:32.728297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:32.737136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:32.742429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:32.744115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 101/210] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:32.748773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:32.846395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729c044-865f-48a0-89d0-241dd5b996f6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:32.899818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c174a08-5701-48f8-9c8f-54c21e3ef5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:32.900730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174a08-5701-48f8-9c8f-54c21e3ef5bb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:32.901221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174a08-5701-48f8-9c8f-54c21e3ef5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:32.901702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174a08-5701-48f8-9c8f-54c21e3ef5bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:32.903394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c174a08-5701-48f8-9c8f-54c21e3ef5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:32.905199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c174a08-5701-48f8-9c8f-54c21e3ef5bb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:32.905886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46e4a1-96b4-4aa6-944b-655db3efcae4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:32.907295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 110/211] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:32.908232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ecb29-828b-4b4c-bb92-8335e0bd47c6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:32.908569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ecb29-828b-4b4c-bb92-8335e0bd47c6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:32.908777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ecb29-828b-4b4c-bb92-8335e0bd47c6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:32.913743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 111/212] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:32.915772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ecb29-828b-4b4c-bb92-8335e0bd47c6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:32.919649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:32.956558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38bbfd-e3d3-4830-bf43-6384c8437e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:32.957476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38bbfd-e3d3-4830-bf43-6384c8437e7f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:32.957917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38bbfd-e3d3-4830-bf43-6384c8437e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:32.958349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38bbfd-e3d3-4830-bf43-6384c8437e7f None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:32.959158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38bbfd-e3d3-4830-bf43-6384c8437e7f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:32.959548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38bbfd-e3d3-4830-bf43-6384c8437e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:32.961146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38bbfd-e3d3-4830-bf43-6384c8437e7f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:32.979710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 102/213] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:32.979710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20f66-e925-4c20-94e8-a2ca9bc3dee6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:32.979710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20f66-e925-4c20-94e8-a2ca9bc3dee6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:32.979710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae20f66-e925-4c20-94e8-a2ca9bc3dee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:32.999403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3ae20f66-e925-4c20-94e8-a2ca9bc3dee6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:33.001333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3ae20f66-e925-4c20-94e8-a2ca9bc3dee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:33.060962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ecb29-828b-4b4c-bb92-8335e0bd47c6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:33.076838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:33.100917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 103/214] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:33.102114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20f66-e925-4c20-94e8-a2ca9bc3dee6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:33.111209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:33.112858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:33.113744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:33.114478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:33.115850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:33.118946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:33.158073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 112/215] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:43:32 2022] POST /identity/v3/users => generated 293 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:43:33.284203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae20f66-e925-4c20-94e8-a2ca9bc3dee6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:33.354307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:33.355717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:33.356424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:33.357057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] PATH_INFO: `/v3/users/d19276116b32439d83147e6912d1c949` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:33.359461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] RBAC: Authorizing `identity:get_user(user_id=d19276116b32439d83147e6912d1c949)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:33.362506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:33.365866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 104/216] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:33 2022] GET /identity/v3/users/d19276116b32439d83147e6912d1c949 => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:33.374381 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:33.424581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:33.484646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:33.529317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:33.575335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858c5e0-2152-42ba-aa83-08dbe641649a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:33.629254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567849e-39d0-40f1-a28e-d72974997220 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:33.658631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:33.659814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:33.660650 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:33.661119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:33.708882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:33.709938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:33.710413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:33.711020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:33.741755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:33.753326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:33.754874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:33.756631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 105/217] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:33.765438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:33.813733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:33.816621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:33.940654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:33.967677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec50706-0458-4bf4-a371-7fc013fc3b4a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:33.999282 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:34.022341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 113/218] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:43:34.031223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:34.042630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:34.043744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:34.044029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:34.044285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:34.044977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:34.045265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:34.046770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:34.056647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 106/219] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:34.062706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:34.225836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddf0c7-3651-437a-aafa-e5df3e979d58 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:34.229834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e15d8b-722c-4098-92ea-785c5abd271f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:34.294359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:34.295420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:34.296468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:34.296638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] PATH_INFO: `/v3/users/0aca4b2d8f8645c99073c8c08861cc2e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:34.306942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:34.308312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:34.308945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:34.309774 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:34.311950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:34.315489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:34.319033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 114/220] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:34 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:34.329302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:34.330815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] RBAC: Authorizing `identity:get_user(user_id=0aca4b2d8f8645c99073c8c08861cc2e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:34.333881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:34.337870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 107/221] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:34 2022] GET /identity/v3/users/0aca4b2d8f8645c99073c8c08861cc2e => generated 293 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:34.349539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:34.383537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:34.396909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:34.514987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00baed5b-b040-4c40-91c5-19d3c963ce05 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:34.535762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eae170-64d2-4d41-b671-9a3222b66ae9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:34.577899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6849f70-362d-42f2-92fc-aa77560cfbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:34.578946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849f70-362d-42f2-92fc-aa77560cfbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:34.579430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849f70-362d-42f2-92fc-aa77560cfbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:34.579924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6849f70-362d-42f2-92fc-aa77560cfbf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:34.581003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6849f70-362d-42f2-92fc-aa77560cfbf1 None admin] RBAC: Adding query filter params (role.id=1df8c96377614e95b2f2fa089b4631f4, user.id=0aca4b2d8f8645c99073c8c08861cc2e, scope.system=all) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:34.581575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6849f70-362d-42f2-92fc-aa77560cfbf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:34.583277 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6849f70-362d-42f2-92fc-aa77560cfbf1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:34.597876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 108/222] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Oct 28 19:43:34 2022] GET /identity/v3/role_assignments?user.id=0aca4b2d8f8645c99073c8c08861cc2e&scope.system=all&role.id=1df8c96377614e95b2f2fa089b4631f4 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:34.618321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15638677-2daa-4ae4-8a90-737bb3b5d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:34.619505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15638677-2daa-4ae4-8a90-737bb3b5d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:34.620045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15638677-2daa-4ae4-8a90-737bb3b5d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:34.620518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15638677-2daa-4ae4-8a90-737bb3b5d1e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:34.622106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15638677-2daa-4ae4-8a90-737bb3b5d1e9 None admin] RBAC: Adding query filter params (role.id=87d93189b26b492587f44cb444bd25c7, scope.project.id=770e1d8530dc4e2999324d107c6c436c, user.id=d19276116b32439d83147e6912d1c949) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:34.622613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15638677-2daa-4ae4-8a90-737bb3b5d1e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:34.625535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15638677-2daa-4ae4-8a90-737bb3b5d1e9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:34.638211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 115/223] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:43:34 2022] GET /identity/v3/role_assignments?user.id=d19276116b32439d83147e6912d1c949&scope.project.id=770e1d8530dc4e2999324d107c6c436c&role.id=87d93189b26b492587f44cb444bd25c7 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:36.500732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be347051-8ef5-44f9-8423-d78fb9f272a3 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:36.501694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be347051-8ef5-44f9-8423-d78fb9f272a3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:36.501694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be347051-8ef5-44f9-8423-d78fb9f272a3 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:36.503187 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 109/224] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:36.509895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26a89-ccce-4a0b-bdfd-4874363ccde8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:36.510452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26a89-ccce-4a0b-bdfd-4874363ccde8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:36.510945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d26a89-ccce-4a0b-bdfd-4874363ccde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:36.523841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7ac5-e0d0-4950-ad26-1d391f5f5dd0 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:36.524152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7ac5-e0d0-4950-ad26-1d391f5f5dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:36.525455 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c7ac5-e0d0-4950-ad26-1d391f5f5dd0 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:36.527110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 110/225] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:36.532809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5508bdd-5fe3-4bdb-993d-b1b01a224afb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:36.533130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5508bdd-5fe3-4bdb-993d-b1b01a224afb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:36.533364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5508bdd-5fe3-4bdb-993d-b1b01a224afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:36.543497 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a5d26a89-ccce-4a0b-bdfd-4874363ccde8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:36.545586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a5d26a89-ccce-4a0b-bdfd-4874363ccde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:36.554583 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f5508bdd-5fe3-4bdb-993d-b1b01a224afb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:36.555824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f5508bdd-5fe3-4bdb-993d-b1b01a224afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:36.652486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 111/226] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:36.679535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 116/227] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:36.927502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5508bdd-5fe3-4bdb-993d-b1b01a224afb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:36.962928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:36.983060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef78d9-6cb5-4605-928d-3de6e078747f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:36.983557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef78d9-6cb5-4605-928d-3de6e078747f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:36.984028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef78d9-6cb5-4605-928d-3de6e078747f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:36.986632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 117/228] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:36.994934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6735-5fe5-451b-b07c-55b025b5b3e6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:36.995418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6735-5fe5-451b-b07c-55b025b5b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:36.995901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c6735-5fe5-451b-b07c-55b025b5b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.027906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ba0c6735-5fe5-451b-b07c-55b025b5b3e6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:37.030021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ba0c6735-5fe5-451b-b07c-55b025b5b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:37.059113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:37.078102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5508bdd-5fe3-4bdb-993d-b1b01a224afb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:37.128220 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:37.128220 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:37.128500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:37.128611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.130202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:37.132033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:37.134576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 112/229] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:37.140199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:37.155368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 118/230] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:37.160501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c6735-5fe5-451b-b07c-55b025b5b3e6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:37.290453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:37.298272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5bf6-60ec-4f5f-b087-e2f35d3f4fbb None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:37.338322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:37.338946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:37.339221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:37.339487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] PATH_INFO: `/v3/groups` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.339984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c6735-5fe5-451b-b07c-55b025b5b3e6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:37.340143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:37.341653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:37.362648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 113/231] 10.222.0.52 () {60 vars in 1134 bytes} [Fri Oct 28 19:43:37 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:43:37.411953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:37.412884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:37.413334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:37.413854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.427449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:37.436602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:37.446312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:37.448088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:37.449757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 119/232] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:37.455810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:37.483684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:37.615400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa239824-6870-4aa8-b76c-497d30017840 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:37.652325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c230c-de0b-46a1-830c-9173140ed823 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:37.670395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:37.671345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:37.671788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:37.672238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.692079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:37.698817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:37.699604 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:37.700017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:37.700414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.701204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:37.701658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:37.702678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:37.704545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:37.706957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:37.708315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:37.708456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 114/233] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:37.714403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:37.721350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 120/234] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:37.727257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:37.744594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:37.833740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:37.893671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51880f2d-a934-4ca3-963f-42fca564b877 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:37.903743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b133236-6f5c-409c-bb17-afc2a5910b01 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:37.952932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:37.953784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:37.954348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:37.954753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.956141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:37.956431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:37.958174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:37.963770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:37.964858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:37.965323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:37.965819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] PATH_INFO: `/v3/users/52e7d7305a094d3a98a5517206874c21` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:37.970222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 115/235] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:37.976873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:37.990231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] RBAC: Authorizing `identity:get_user(user_id=52e7d7305a094d3a98a5517206874c21)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:37.992139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:37.994812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 121/236] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:37 2022] GET /identity/v3/users/52e7d7305a094d3a98a5517206874c21 => generated 293 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:38.004279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:38.089769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:38.119133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9de70-b2b4-4aeb-ac07-acbc8b1cd17c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:38.175911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:38.176860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:38.177316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:38.177785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] PATH_INFO: `/v3/users/0aca4b2d8f8645c99073c8c08861cc2e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:38.179940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] RBAC: Authorizing `identity:get_user(user_id=0aca4b2d8f8645c99073c8c08861cc2e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:38.182230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:38.185339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 116/237] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:37 2022] GET /identity/v3/users/0aca4b2d8f8645c99073c8c08861cc2e => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:38.194045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:38.199457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63ebc6-a811-4db3-a737-6b4cd556d96e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:38.249315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:38.260882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ab9bf-34c7-4c44-9ea5-8ff234000d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:38.261846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ab9bf-34c7-4c44-9ea5-8ff234000d22 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:38.262259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ab9bf-34c7-4c44-9ea5-8ff234000d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:38.262687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ab9bf-34c7-4c44-9ea5-8ff234000d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:38.263897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ab9bf-34c7-4c44-9ea5-8ff234000d22 None admin] RBAC: Adding query filter params (role.id=87d93189b26b492587f44cb444bd25c7, user.id=52e7d7305a094d3a98a5517206874c21, scope.system=all) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:38.264376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ab9bf-34c7-4c44-9ea5-8ff234000d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:38.266983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ab9bf-34c7-4c44-9ea5-8ff234000d22 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:38.277248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 122/238] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Oct 28 19:43:38 2022] GET /identity/v3/role_assignments?user.id=52e7d7305a094d3a98a5517206874c21&scope.system=all&role.id=87d93189b26b492587f44cb444bd25c7 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:38.368025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0394c9e-93b2-4a48-b671-70ee3020793e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:38.412060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc9c21-6b43-4e53-89a6-8734a69e1b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:38.412759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc9c21-6b43-4e53-89a6-8734a69e1b76 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:38.413039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc9c21-6b43-4e53-89a6-8734a69e1b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:38.413326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc9c21-6b43-4e53-89a6-8734a69e1b76 None admin] PATH_INFO: `/v3/system/users/0aca4b2d8f8645c99073c8c08861cc2e/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:38.415056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc9c21-6b43-4e53-89a6-8734a69e1b76 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0aca4b2d8f8645c99073c8c08861cc2e, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:38.416586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc9c21-6b43-4e53-89a6-8734a69e1b76 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:38.431411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 117/239] 10.222.0.52 () {58 vars in 1334 bytes} [Fri Oct 28 19:43:38 2022] PUT /identity/v3/system/users/0aca4b2d8f8645c99073c8c08861cc2e/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:43:39.978867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdfec0-8561-4dee-b401-1842d75a4555 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:39.979701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdfec0-8561-4dee-b401-1842d75a4555 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:39.979701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdfec0-8561-4dee-b401-1842d75a4555 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:39.981181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 123/240] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:39.987116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde70ac-6737-4555-bb8f-a3258b0977b3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:39.987942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde70ac-6737-4555-bb8f-a3258b0977b3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:39.987942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fde70ac-6737-4555-bb8f-a3258b0977b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:40.008252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7fde70ac-6737-4555-bb8f-a3258b0977b3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:40.009507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7fde70ac-6737-4555-bb8f-a3258b0977b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:40.014431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:40.101506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 118/241] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:40.602684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdfec0-8561-4dee-b401-1842d75a4555 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:40.697136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1e02-9d84-4694-85af-b778ab228d39 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:40.697433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1e02-9d84-4694-85af-b778ab228d39 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:40.697708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1e02-9d84-4694-85af-b778ab228d39 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:40.699088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 119/242] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:40.705079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b4e6-5d1f-4e35-91fb-612c5852842d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:40.705542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b4e6-5d1f-4e35-91fb-612c5852842d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:40.705819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b4e6-5d1f-4e35-91fb-612c5852842d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:40.730143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3186b4e6-5d1f-4e35-91fb-612c5852842d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:40.731367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3186b4e6-5d1f-4e35-91fb-612c5852842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:40.747241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdfec0-8561-4dee-b401-1842d75a4555 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:40.799164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:40.800241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:40.800724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:40.801186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:40.803208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:40.806043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:40.809219 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 124/243] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:40.818821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:40.832343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 120/244] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:40.904336 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:40.953801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f078a8-ca03-433a-8268-d23eee4d1341 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:41.004764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0322da-6a9a-4116-93a9-60b7138e1f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:41.004764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0322da-6a9a-4116-93a9-60b7138e1f9f None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:41.004764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0322da-6a9a-4116-93a9-60b7138e1f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:41.004764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0322da-6a9a-4116-93a9-60b7138e1f9f None admin] PATH_INFO: `/v3/groups` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:41.006144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0322da-6a9a-4116-93a9-60b7138e1f9f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:41.006144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0322da-6a9a-4116-93a9-60b7138e1f9f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:41.033447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 125/245] 10.222.0.52 () {60 vars in 1134 bytes} [Fri Oct 28 19:43:40 2022] POST /identity/v3/groups => generated 226 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:43:41.307831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7492d-b58e-4e19-97b3-f4d6f9f15f48 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:41.308631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7492d-b58e-4e19-97b3-f4d6f9f15f48 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:41.308631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7492d-b58e-4e19-97b3-f4d6f9f15f48 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:41.309845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 121/246] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:41.316996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f099b-a92a-4266-bd7d-b217dc88c0b3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:41.317457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f099b-a92a-4266-bd7d-b217dc88c0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:41.317885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f099b-a92a-4266-bd7d-b217dc88c0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:41.336837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7492d-b58e-4e19-97b3-f4d6f9f15f48 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:41.348070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-113f099b-a92a-4266-bd7d-b217dc88c0b3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:41.350122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-113f099b-a92a-4266-bd7d-b217dc88c0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:41.455080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:41.482294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 126/247] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:41.519404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7492d-b58e-4e19-97b3-f4d6f9f15f48 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:41.586426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:41.587465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:41.587966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:41.588418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:41.609196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:41.618924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:41.620123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:41.620924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:41.622595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 122/248] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:41.631469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f099b-a92a-4266-bd7d-b217dc88c0b3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:41.733059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:41.831645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f099b-a92a-4266-bd7d-b217dc88c0b3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:41.917948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:41.918991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:41.919460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:41.919899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:41.921042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:41.921560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:41.924090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:41.941151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 127/249] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:41.950999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:42.026922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:42.174437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3193cf-611a-4e7e-a003-db0d8f56e54a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:42.251150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:42.266229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:42.268287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:42.269057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:42.270231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] PATH_INFO: `/v3/users/0aca4b2d8f8645c99073c8c08861cc2e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:42.274265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] RBAC: Authorizing `identity:get_user(user_id=0aca4b2d8f8645c99073c8c08861cc2e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:42.276905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2449ce4-0851-4681-9371-45b5b084b939 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:42.277829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:42.283298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 123/250] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:41 2022] GET /identity/v3/users/0aca4b2d8f8645c99073c8c08861cc2e => generated 293 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:42.294358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:42.310401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:42.362668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:42.364792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:42.365597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:42.366342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:42.392121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:42.406418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:42.408147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:42.409779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:42.413316 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 128/251] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:42.422280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:42.565794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583da1b-868d-4d2b-985e-85c8dabf4811 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:42.676807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:42.677975 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:42.678878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:42.679357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:42.680784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] RBAC: Adding query filter params (role.id=1df8c96377614e95b2f2fa089b4631f4, user.id=0aca4b2d8f8645c99073c8c08861cc2e, scope.system=all) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:42.681331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:42.684052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:42.724393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 124/252] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Oct 28 19:43:42 2022] GET /identity/v3/role_assignments?user.id=0aca4b2d8f8645c99073c8c08861cc2e&scope.system=all&role.id=1df8c96377614e95b2f2fa089b4631f4 => generated 510 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:42.741119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dcee65-b642-4280-abca-75e99665511c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:42.818966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:42.820078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:42.820567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:42.821034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:42.822375 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:42.822865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:42.825632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:42.846181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 129/253] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:42.854561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:42.972849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:43.065813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc2c3a-a846-4437-8005-ad652fccd31b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:43.135375 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634ec04-8181-4ca2-b36b-4a471a28b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:43.135970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ec04-8181-4ca2-b36b-4a471a28b92c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:43.136250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ec04-8181-4ca2-b36b-4a471a28b92c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:43.136523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634ec04-8181-4ca2-b36b-4a471a28b92c None admin] PATH_INFO: `/v3/users/52e7d7305a094d3a98a5517206874c21` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:43.137855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634ec04-8181-4ca2-b36b-4a471a28b92c None admin] RBAC: Authorizing `identity:get_user(user_id=52e7d7305a094d3a98a5517206874c21)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:43.139383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634ec04-8181-4ca2-b36b-4a471a28b92c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:43.141161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 125/254] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:42 2022] GET /identity/v3/users/52e7d7305a094d3a98a5517206874c21 => generated 293 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:43.150855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:43.203360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:43.290445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab76493-d6ea-4afb-ab04-05cc34f21b2c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:43.349620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7718ff-95b6-410a-81ae-7417e7ea86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:43.350306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7718ff-95b6-410a-81ae-7417e7ea86a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:43.350586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7718ff-95b6-410a-81ae-7417e7ea86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:43.350858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7718ff-95b6-410a-81ae-7417e7ea86a3 None admin] PATH_INFO: `/v3/system/users/52e7d7305a094d3a98a5517206874c21/roles/87d93189b26b492587f44cb444bd25c7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:43.352505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7718ff-95b6-410a-81ae-7417e7ea86a3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=52e7d7305a094d3a98a5517206874c21, role_id=87d93189b26b492587f44cb444bd25c7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:43.354033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7718ff-95b6-410a-81ae-7417e7ea86a3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:43.371898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 130/255] 10.222.0.52 () {58 vars in 1334 bytes} [Fri Oct 28 19:43:43 2022] PUT /identity/v3/system/users/52e7d7305a094d3a98a5517206874c21/roles/87d93189b26b492587f44cb444bd25c7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:43:44.335059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed9a-1194-4667-a8d0-a4ebf8486c55 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:44.336100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed9a-1194-4667-a8d0-a4ebf8486c55 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:44.336624 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed9a-1194-4667-a8d0-a4ebf8486c55 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:44.338321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 126/256] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:44.344664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a09c-9d5e-4c29-9ed2-35556f770a5d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:44.345861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a09c-9d5e-4c29-9ed2-35556f770a5d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:44.346360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a09c-9d5e-4c29-9ed2-35556f770a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:44.382152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2315a09c-9d5e-4c29-9ed2-35556f770a5d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:44.383856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2315a09c-9d5e-4c29-9ed2-35556f770a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:44.484070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 131/257] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:43:44.649532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042009-45da-4cb7-9a38-95ead6d7a871 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:44.649532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042009-45da-4cb7-9a38-95ead6d7a871 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:44.649532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e042009-45da-4cb7-9a38-95ead6d7a871 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:44.650149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 127/258] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:44.661776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d273ff-6456-4227-9cfb-d7417f9869b6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:44.661776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d273ff-6456-4227-9cfb-d7417f9869b6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:44.661776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d273ff-6456-4227-9cfb-d7417f9869b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:44.706673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f4d273ff-6456-4227-9cfb-d7417f9869b6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:44.708338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f4d273ff-6456-4227-9cfb-d7417f9869b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:44.722773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 132/259] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 28 19:43:44.877628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e042009-45da-4cb7-9a38-95ead6d7a871 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:44.903421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e042009-45da-4cb7-9a38-95ead6d7a871 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:44.914241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:44.915282 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:44.915802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:44.916268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:44.946577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:44.952183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:44.953106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:44.953927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:44.956421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 128/260] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Oct 28 19:43:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:44.962881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d273ff-6456-4227-9cfb-d7417f9869b6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:44.973550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d273ff-6456-4227-9cfb-d7417f9869b6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:44.984906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:44.986051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:44.986616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:44.987113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:44.988118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:44.988686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:44.991023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:43:44.991023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:43:44.991023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:43:44.992415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.011091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 133/261] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:43:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:45.016598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.036554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968ead03-9065-47fd-94ab-7c15e03b32f3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.044509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.045658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.046191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.046670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.059062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:45.061463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:43:45.061463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:43:45.061463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:43:45.063297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.065480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 129/262] 10.222.0.52 () {56 vars in 1201 bytes} [Fri Oct 28 19:43:45 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:45.071725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.087223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f726f80-7873-4cca-84f4-60582556a913 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.096981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.098131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.098637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.099114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.102847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:45.107075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.110782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 134/263] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Oct 28 19:43:45 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:45.122578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.140287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de239c8d-46c0-4003-906f-3f048dfcad02 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.155609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.156718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.157211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.157739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.160260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e08162201c94003bcd1bfda733b4fdc, group_id=d1ecca2f07a54002b3ffc24e1909b901, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:45.161725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:43:45.161725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:43:45.161725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:43:45.164252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.207196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 130/264] 10.222.0.52 () {58 vars in 1463 bytes} [Fri Oct 28 19:43:45 2022] PUT /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:45.343766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.354731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df70deb-ea55-4404-8411-703891b4c43c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.387905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:45.433251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.433832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.434111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.434386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.454494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:45.459853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:45.462712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:45.465883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 135/265] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Oct 28 19:43:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:45.468958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.487708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0790d5-5a72-41e2-9fa3-77a27dcd1463 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.495062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.496142 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.496675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.497124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.498185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:45.498690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:45.500011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:43:45.500011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:43:45.500011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:43:45.501457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.515787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 131/266] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Oct 28 19:43:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:45.522295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.539185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3176f-44f4-432a-a566-7f2b1bdc0160 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.550250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.550922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.551200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.551467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.552819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:45.553915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:43:45.553915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:43:45.553915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:43:45.555169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.557284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 136/267] 10.222.0.52 () {56 vars in 1201 bytes} [Fri Oct 28 19:43:45 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:45.563570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.576399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c363e1-1dc0-4d3c-95bf-707194c56a0f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.584408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b2336-6e2a-4724-ad4c-2345e39486e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.585531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2336-6e2a-4724-ad4c-2345e39486e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.586013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2336-6e2a-4724-ad4c-2345e39486e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.586462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b2336-6e2a-4724-ad4c-2345e39486e8 admin admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.588716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b2336-6e2a-4724-ad4c-2345e39486e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:45.591476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b2336-6e2a-4724-ad4c-2345e39486e8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.593716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 132/268] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Oct 28 19:43:45 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:45.600504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:45.615450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fcee5-4d73-4353-8556-b95377584aab admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:45.625333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f44556-11a7-48d0-94f1-a2b864fb23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:45.626048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44556-11a7-48d0-94f1-a2b864fb23d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:45.626323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44556-11a7-48d0-94f1-a2b864fb23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:45.626591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f44556-11a7-48d0-94f1-a2b864fb23d3 admin admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/3b63b6b8ba3a43158d1be9fe4d2322d5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:45.631607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f44556-11a7-48d0-94f1-a2b864fb23d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e08162201c94003bcd1bfda733b4fdc, group_id=d1ecca2f07a54002b3ffc24e1909b901, role_id=3b63b6b8ba3a43158d1be9fe4d2322d5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:45.632670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-99f44556-11a7-48d0-94f1-a2b864fb23d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:43:45.632670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:43:45.632670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:43:45.634705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f44556-11a7-48d0-94f1-a2b864fb23d3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:45.657031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 137/269] 10.222.0.52 () {58 vars in 1463 bytes} [Fri Oct 28 19:43:45 2022] PUT /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:43:46.011191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220f96f-1c7b-434a-993f-956a4a04e2e8 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:46.011931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220f96f-1c7b-434a-993f-956a4a04e2e8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:46.012470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f220f96f-1c7b-434a-993f-956a4a04e2e8 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:46.014124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 133/270] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:46.020073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346493b6-41d0-44ef-b4c3-3081ba2ffbbe None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:46.020692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346493b6-41d0-44ef-b4c3-3081ba2ffbbe None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:46.021180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346493b6-41d0-44ef-b4c3-3081ba2ffbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:46.047731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-346493b6-41d0-44ef-b4c3-3081ba2ffbbe None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:46.049759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-346493b6-41d0-44ef-b4c3-3081ba2ffbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:46.134908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 138/271] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:43:46.695793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220f96f-1c7b-434a-993f-956a4a04e2e8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:46.716018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f220f96f-1c7b-434a-993f-956a4a04e2e8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:46.721027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:46.722048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:46.722528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:46.722994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:46.741784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:46.747703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:46.748655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:46.749485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:46.751957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 134/272] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Oct 28 19:43:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:46.758418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346493b6-41d0-44ef-b4c3-3081ba2ffbbe None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:46.769026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346493b6-41d0-44ef-b4c3-3081ba2ffbbe None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:46.777257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:46.778314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:46.778797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:46.779282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:46.780178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:46.780699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:46.782617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:46.794759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 139/273] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:43:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:46.801299 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:46.814196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09596b1-7ff4-452e-949d-6678cba9e501 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:46.820500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:46.821655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:46.822177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:46.822683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:46.824318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:46.826584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:46.833581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 135/274] 10.222.0.52 () {56 vars in 1201 bytes} [Fri Oct 28 19:43:46 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:46.835413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:46.846727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909305d-45a9-49df-a1e2-13047a7b5237 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:46.851843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca008ba1-66e3-4c69-ba67-124f52969c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:46.852510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008ba1-66e3-4c69-ba67-124f52969c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:46.852788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008ba1-66e3-4c69-ba67-124f52969c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:46.853063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca008ba1-66e3-4c69-ba67-124f52969c09 admin admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:46.854337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca008ba1-66e3-4c69-ba67-124f52969c09 admin admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:46.856561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca008ba1-66e3-4c69-ba67-124f52969c09 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:46.863454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 140/275] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Oct 28 19:43:46 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:46.866825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:46.878446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d0d6-156c-4c70-b0c7-57ed5c1c5d32 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:46.883128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeee186-7bdb-4100-96b2-7ab9c83831cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:46.883842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeee186-7bdb-4100-96b2-7ab9c83831cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:46.884603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeee186-7bdb-4100-96b2-7ab9c83831cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:46.884893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeee186-7bdb-4100-96b2-7ab9c83831cb admin admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:46.886995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeee186-7bdb-4100-96b2-7ab9c83831cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e1d8530dc4e2999324d107c6c436c, group_id=d1ecca2f07a54002b3ffc24e1909b901, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:46.889761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeee186-7bdb-4100-96b2-7ab9c83831cb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:46.919893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 136/276] 10.222.0.52 () {58 vars in 1463 bytes} [Fri Oct 28 19:43:46 2022] PUT /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:47.206688 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af799-2cf6-4751-91c4-b44871733b7d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.206962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af799-2cf6-4751-91c4-b44871733b7d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.207388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8af799-2cf6-4751-91c4-b44871733b7d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.208669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 141/277] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:47.214898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b141-6001-4c7b-9513-998e5df0e374 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.215296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b141-6001-4c7b-9513-998e5df0e374 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.215544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b141-6001-4c7b-9513-998e5df0e374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.239123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e800b141-6001-4c7b-9513-998e5df0e374 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:47.240371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e800b141-6001-4c7b-9513-998e5df0e374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:47.318376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:47.335068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 137/278] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:43:47.719126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710bdb-0610-4fcd-9acc-1ef254a5888f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.719126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710bdb-0610-4fcd-9acc-1ef254a5888f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.719126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44710bdb-0610-4fcd-9acc-1ef254a5888f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.719126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 142/279] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:47.735610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bf54d-4c75-4703-ad3b-1e8a8d058d7b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.736456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bf54d-4c75-4703-ad3b-1e8a8d058d7b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.736456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bf54d-4c75-4703-ad3b-1e8a8d058d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.761979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c27bf54d-4c75-4703-ad3b-1e8a8d058d7b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:47.763318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c27bf54d-4c75-4703-ad3b-1e8a8d058d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:47.816863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710bdb-0610-4fcd-9acc-1ef254a5888f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:47.837953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44710bdb-0610-4fcd-9acc-1ef254a5888f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:47.842785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:47.843444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.843723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.843998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.856710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:47.863405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:47.865136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:47.867158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 143/280] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Oct 28 19:43:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:47.871768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:47.881837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 138/281] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:47.883907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ce51a1-88cd-4aef-81fb-bd6924e9e8e9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:47.888849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f5b4d8-5483-4377-8ea8-5b467959d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:47.889529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5b4d8-5483-4377-8ea8-5b467959d175 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.889922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5b4d8-5483-4377-8ea8-5b467959d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.890190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f5b4d8-5483-4377-8ea8-5b467959d175 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.890875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5b4d8-5483-4377-8ea8-5b467959d175 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:47.891225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5b4d8-5483-4377-8ea8-5b467959d175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:47.893008 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f5b4d8-5483-4377-8ea8-5b467959d175 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:47.903899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 144/282] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Oct 28 19:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:47.909936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bf54d-4c75-4703-ad3b-1e8a8d058d7b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:47.937869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bf54d-4c75-4703-ad3b-1e8a8d058d7b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:47.944600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1927-067a-4913-b300-51bbf29b10d6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.945002 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:47.945270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1927-067a-4913-b300-51bbf29b10d6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.945270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba1927-067a-4913-b300-51bbf29b10d6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.945794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.945794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.946224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.946772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 145/283] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:47.947623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:47.949838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:47.951843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 139/284] 10.222.0.52 () {56 vars in 1201 bytes} [Fri Oct 28 19:43:47 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:47.956408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425342ce-c1c3-4c3d-b235-ce954708d83f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.956792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425342ce-c1c3-4c3d-b235-ce954708d83f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.957025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425342ce-c1c3-4c3d-b235-ce954708d83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.958624 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:47.979937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4297-369f-4925-b179-4f1dd3292cd5 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:47.992846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:47.993502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:47.993766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:47.994030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:47.995466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:48.005191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:48.007133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 140/285] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Oct 28 19:43:47 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:48.009327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-425342ce-c1c3-4c3d-b235-ce954708d83f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:48.010613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-425342ce-c1c3-4c3d-b235-ce954708d83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:48.018756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.032454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 146/286] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 28 19:43:48.036352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25298a6-0644-4423-bd60-2108e47f121c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.044002 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.044755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.045036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.045298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/3b63b6b8ba3a43158d1be9fe4d2322d5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.051668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=770e1d8530dc4e2999324d107c6c436c, group_id=d1ecca2f07a54002b3ffc24e1909b901, role_id=3b63b6b8ba3a43158d1be9fe4d2322d5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:48.054467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:48.083257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 141/287] 10.222.0.52 () {58 vars in 1463 bytes} [Fri Oct 28 19:43:48 2022] PUT /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c/groups/d1ecca2f07a54002b3ffc24e1909b901/roles/3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:43:48.254296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425342ce-c1c3-4c3d-b235-ce954708d83f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.338388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:48.395088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425342ce-c1c3-4c3d-b235-ce954708d83f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.435560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d307086-2512-4057-9239-cda0f189280b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.436223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d307086-2512-4057-9239-cda0f189280b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.436501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d307086-2512-4057-9239-cda0f189280b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.436770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d307086-2512-4057-9239-cda0f189280b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.449338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d307086-2512-4057-9239-cda0f189280b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9d307086-2512-4057-9239-cda0f189280b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:48.454588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:48.457279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:48.459066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 147/288] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:48.465437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.596109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b9d1f-3336-4819-a026-3c922526cd3f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.604740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:48.639488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d307086-2512-4057-9239-cda0f189280b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.646313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.647020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.647300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.647568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.648630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:48.648931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:48.651555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:48.665576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 142/289] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:48.680085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.765187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d307086-2512-4057-9239-cda0f189280b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.780383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.781607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.781607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.781783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.804118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:48.814151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:48.815192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:48.817699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 148/290] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:43:48.822908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.838946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b719bb3-0a63-4a6b-be4b-6c2fd6b035fd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.847972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.848546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.848822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.849088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.849811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:48.850113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:48.855759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:48.879660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 149/291] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:48.883395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.903672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c802fe3-8c1a-4263-a16c-dcae65a785df admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.905259 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a7603-050f-4a92-b99a-d148a2e07a70 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.916259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.916923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.917204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.917522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] PATH_INFO: `/v3/groups/11a5fea29e0c47989c90f91d3908d0ad` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.934559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] RBAC: Authorizing `identity:get_group(group_id=11a5fea29e0c47989c90f91d3908d0ad)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:48.938640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:48.942118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 150/292] 10.222.0.52 () {56 vars in 1201 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/groups/11a5fea29e0c47989c90f91d3908d0ad => generated 229 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:48.947529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.970435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d9aa4-b8cb-4f32-88cb-4ea0b53afbab admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:48.972746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.973600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.973889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.974164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] PATH_INFO: `/v3/users/52e7d7305a094d3a98a5517206874c21` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.975566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] RBAC: Authorizing `identity:get_user(user_id=52e7d7305a094d3a98a5517206874c21)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:48.977247 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:48.979715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 143/293] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/users/52e7d7305a094d3a98a5517206874c21 => generated 293 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:48.986435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:48.995310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:48.995973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:48.996324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:48.996599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] PATH_INFO: `/v3/projects/46afb98b47654c2ebe18eaaa061df1b1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:48.998180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] RBAC: Authorizing `identity:get_project(project_id=46afb98b47654c2ebe18eaaa061df1b1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:49.000148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:49.002319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 151/294] 10.222.0.52 () {56 vars in 1207 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/projects/46afb98b47654c2ebe18eaaa061df1b1 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:49.008415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:49.032188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e44282-a251-4a28-a06a-87b3ff5ba230 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:49.034726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:49.054156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56886551-9bf3-4d52-b113-902f242a99cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:49.054851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886551-9bf3-4d52-b113-902f242a99cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:49.057999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886551-9bf3-4d52-b113-902f242a99cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:49.058277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56886551-9bf3-4d52-b113-902f242a99cb admin admin] PATH_INFO: `/v3/projects/46afb98b47654c2ebe18eaaa061df1b1/groups/11a5fea29e0c47989c90f91d3908d0ad/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:49.063598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56886551-9bf3-4d52-b113-902f242a99cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=46afb98b47654c2ebe18eaaa061df1b1, group_id=11a5fea29e0c47989c90f91d3908d0ad, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:49.070148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56886551-9bf3-4d52-b113-902f242a99cb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:49.096611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 152/295] 10.222.0.52 () {58 vars in 1463 bytes} [Fri Oct 28 19:43:49 2022] PUT /identity/v3/projects/46afb98b47654c2ebe18eaaa061df1b1/groups/11a5fea29e0c47989c90f91d3908d0ad/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:43:49.174328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938895cf-282f-477c-a1cb-598f3337fedc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:49.220935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ad231-d440-48c1-8c92-f30ba4ae07c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:49.221864 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad231-d440-48c1-8c92-f30ba4ae07c7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:49.222201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad231-d440-48c1-8c92-f30ba4ae07c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:49.222737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad231-d440-48c1-8c92-f30ba4ae07c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:49.224018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad231-d440-48c1-8c92-f30ba4ae07c7 None admin] RBAC: Adding query filter params (role.id=87d93189b26b492587f44cb444bd25c7, user.id=52e7d7305a094d3a98a5517206874c21, scope.system=all) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:49.224348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad231-d440-48c1-8c92-f30ba4ae07c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:49.225860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad231-d440-48c1-8c92-f30ba4ae07c7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:49.244256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 144/296] 10.222.0.52 () {56 vars in 1308 bytes} [Fri Oct 28 19:43:48 2022] GET /identity/v3/role_assignments?user.id=52e7d7305a094d3a98a5517206874c21&scope.system=all&role.id=87d93189b26b492587f44cb444bd25c7 => generated 510 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:49.962903 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac91f-409c-4180-b53f-17451773e2b9 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:49.963695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac91f-409c-4180-b53f-17451773e2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:49.963695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ac91f-409c-4180-b53f-17451773e2b9 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:49.965300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 153/297] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:43:49.973080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35b95-42f9-4e10-b3c6-8f418cfbb96c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:49.974059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35b95-42f9-4e10-b3c6-8f418cfbb96c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:49.974059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35b95-42f9-4e10-b3c6-8f418cfbb96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:49.994655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-39b35b95-42f9-4e10-b3c6-8f418cfbb96c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:49.995873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-39b35b95-42f9-4e10-b3c6-8f418cfbb96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:50.070597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765216d4-d4d1-4eb6-83e2-d3604da83870 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:50.070863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765216d4-d4d1-4eb6-83e2-d3604da83870 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:50.071203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765216d4-d4d1-4eb6-83e2-d3604da83870 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:50.072827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 154/298] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:50.082184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234440-3973-496b-a566-c272025af01f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:50.082572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234440-3973-496b-a566-c272025af01f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:50.082811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234440-3973-496b-a566-c272025af01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:50.101651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 145/299] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:50.106828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8f234440-3973-496b-a566-c272025af01f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:50.108200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8f234440-3973-496b-a566-c272025af01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:50.125220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:50.204506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 155/300] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:50.418456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b35b95-42f9-4e10-b3c6-8f418cfbb96c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:50.449978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:50.546279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b35b95-42f9-4e10-b3c6-8f418cfbb96c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:50.597792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:50.598449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:50.598721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:50.598982 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:50.620989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:50.625949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:50.626884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:50.627677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:50.628267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 146/301] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:50.634953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234440-3973-496b-a566-c272025af01f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:50.783865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234440-3973-496b-a566-c272025af01f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:50.802556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:50.831463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:50.832924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:50.833563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:50.834064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:50.835143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:50.835670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:50.837326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:50.852298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 156/302] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:50.854108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:50.889901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:50.979837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:50.998041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f4828-d491-4a64-bb2a-a6acbc8ba2f3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:51.022541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee106b98-d63b-471f-bf7a-2dc21a1cca8f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:51.071037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ebc3a3-4dde-4931-bf8e-7fc057842f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:51.071556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebc3a3-4dde-4931-bf8e-7fc057842f6a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.071836 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebc3a3-4dde-4931-bf8e-7fc057842f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.072111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ebc3a3-4dde-4931-bf8e-7fc057842f6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.084499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f5c25-d054-4647-aa95-a100e5cb87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:51.085607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5c25-d054-4647-aa95-a100e5cb87a0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.086189 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5c25-d054-4647-aa95-a100e5cb87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.086673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f5c25-d054-4647-aa95-a100e5cb87a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.100841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f5c25-d054-4647-aa95-a100e5cb87a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-e27f5c25-d054-4647-aa95-a100e5cb87a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:51.107427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:51.108380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:51.109162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:51.112814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 147/303] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:43:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:51.115813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47b79-d4ed-49e7-82c7-36328eb4d9bd None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.118150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47b79-d4ed-49e7-82c7-36328eb4d9bd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.118639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c47b79-d4ed-49e7-82c7-36328eb4d9bd None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.121757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 148/304] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:51.122903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c47b79-d4ed-49e7-82c7-36328eb4d9bd None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:51.160238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebc3a3-4dde-4931-bf8e-7fc057842f6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:51.161866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ebc3a3-4dde-4931-bf8e-7fc057842f6a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:51.178610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:51.288124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c47b79-d4ed-49e7-82c7-36328eb4d9bd None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:51.298072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 157/305] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:51.304852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7e68-9d9f-4d4a-8d69-1f9887ec19eb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.305513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7e68-9d9f-4d4a-8d69-1f9887ec19eb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.305983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7e68-9d9f-4d4a-8d69-1f9887ec19eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.328218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-244e7e68-9d9f-4d4a-8d69-1f9887ec19eb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:51.332332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-244e7e68-9d9f-4d4a-8d69-1f9887ec19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:51.360622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:51.361758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.362246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.362721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.363642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:51.364151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:51.365970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:51.376348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 149/306] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:43:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:51.377732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:51.389792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:51.477856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 158/307] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:51.479032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7e68-9d9f-4d4a-8d69-1f9887ec19eb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:51.534147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e9f9-4179-4906-b0f7-7392eee5cb53 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:51.552439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:51.612566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:51.614117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.614795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.615418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.617875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:51.620879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:51.624790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 150/308] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:51 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:51.638521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:51.665426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7e68-9d9f-4d4a-8d69-1f9887ec19eb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:51.722092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78130cc-3223-4934-a44c-836b5ec82605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:51.722987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78130cc-3223-4934-a44c-836b5ec82605 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.723428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78130cc-3223-4934-a44c-836b5ec82605 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.723818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78130cc-3223-4934-a44c-836b5ec82605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.857300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78130cc-3223-4934-a44c-836b5ec82605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:51.861908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78130cc-3223-4934-a44c-836b5ec82605 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:51.869826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:51.921865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3f07d-143e-4f5f-813f-8d1d3520e0da None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:51.943722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:51.989197 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db07b8-a9b4-49dd-9a7c-01058999fd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:51.991278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db07b8-a9b4-49dd-9a7c-01058999fd37 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:51.992056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db07b8-a9b4-49dd-9a7c-01058999fd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:51.992828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db07b8-a9b4-49dd-9a7c-01058999fd37 None admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:51.998224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db07b8-a9b4-49dd-9a7c-01058999fd37 None admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:52.003808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db07b8-a9b4-49dd-9a7c-01058999fd37 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:52.009036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 151/309] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Oct 28 19:43:51 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:52.011745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04805-fb16-4a85-afa9-87ed1e5c7988 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:52.012593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04805-fb16-4a85-afa9-87ed1e5c7988 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:52.013334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04805-fb16-4a85-afa9-87ed1e5c7988 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:52.016770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 152/310] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:52.018834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04805-fb16-4a85-afa9-87ed1e5c7988 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:52.047535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 159/311] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:52.048963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f1721-131b-44e7-86c2-2571a4a25158 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:52.049246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f1721-131b-44e7-86c2-2571a4a25158 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:52.051884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f1721-131b-44e7-86c2-2571a4a25158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:52.074691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a62f1721-131b-44e7-86c2-2571a4a25158 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:52.075949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a62f1721-131b-44e7-86c2-2571a4a25158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:52.171885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 160/312] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:52.172420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f1721-131b-44e7-86c2-2571a4a25158 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:52.211154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04805-fb16-4a85-afa9-87ed1e5c7988 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:52.256866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:52.258643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:52.259177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:52.259840 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:52.261306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] RBAC: Adding query filter params (group.id=d1ecca2f07a54002b3ffc24e1909b901, role.id=1df8c96377614e95b2f2fa089b4631f4, scope.project.id=3e08162201c94003bcd1bfda733b4fdc) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:52.261949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:52.264978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:52.277824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 153/313] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Oct 28 19:43:52 2022] GET /identity/v3/role_assignments?group.id=d1ecca2f07a54002b3ffc24e1909b901&scope.project.id=3e08162201c94003bcd1bfda733b4fdc&role.id=1df8c96377614e95b2f2fa089b4631f4 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:52.285422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:52.303493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:52.309130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:52.360198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f1721-131b-44e7-86c2-2571a4a25158 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:52.447340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:52.448085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:52.448365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:52.448638 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] PATH_INFO: `/v3/projects/3e08162201c94003bcd1bfda733b4fdc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:52.454390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] RBAC: Authorizing `identity:get_project(project_id=3e08162201c94003bcd1bfda733b4fdc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:52.455970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:52.458151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 161/314] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:52 2022] GET /identity/v3/projects/3e08162201c94003bcd1bfda733b4fdc => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:52.467491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:52.528527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2af6e-3742-4050-9082-ce9c50c65403 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:52.586313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:52.587096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:52.587372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:52.587651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:52.603367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:52.610157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:52.612063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:52.613602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 154/315] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:52.618114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:52.655685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68fe37-932a-4c4a-8f52-fe725684bc15 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:52.697897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:52.698675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:52.699060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:52.699466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:52.700846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:52.702775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:52.705023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 162/316] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Oct 28 19:43:52 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:52.714514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:52.730844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:52.752622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:52.817649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9918d4-efb2-4218-a6fc-3dc9ff026327 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:52.887946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:52.889632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:52.890055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:52.890484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:52.891588 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:52.892040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:52.895293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:52.913857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 155/317] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:43:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:52.915414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:52.938597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4fa9d-62f4-4baf-9ff3-ab3adda81ce1 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:53.022481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:53.023529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:53.024008 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:53.025998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:53.030703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] RBAC: Adding query filter params (group.id=d1ecca2f07a54002b3ffc24e1909b901, role.id=3b63b6b8ba3a43158d1be9fe4d2322d5, scope.project.id=3e08162201c94003bcd1bfda733b4fdc) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:53.031349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:53.033298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:53.046024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 163/318] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Oct 28 19:43:52 2022] GET /identity/v3/role_assignments?group.id=d1ecca2f07a54002b3ffc24e1909b901&scope.project.id=3e08162201c94003bcd1bfda733b4fdc&role.id=3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 611 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:53.047321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:53.125443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4ab2-c27a-4727-b0c8-0f02ca607cd0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:53.176456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:53.203162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:53.222698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e051dc-5054-4fb6-b9ab-eed5d8cad113 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:53.228540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:53.229691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:53.230157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:53.230639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:53.264197 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:53.270610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70834b3f-da42-41b0-b4a8-849db5dd2e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:53.271679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70834b3f-da42-41b0-b4a8-849db5dd2e80 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:53.272198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70834b3f-da42-41b0-b4a8-849db5dd2e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:53.272755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70834b3f-da42-41b0-b4a8-849db5dd2e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:53.276083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:53.277074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:43:53.277883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:43:53.278521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 156/319] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:43:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:53.289104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:53.365727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70834b3f-da42-41b0-b4a8-849db5dd2e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:53.367678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70834b3f-da42-41b0-b4a8-849db5dd2e80 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:53.476566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:53.531029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 164/320] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:53.532699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bdf8d-382f-4835-a364-2cb3cd28e8a3 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:53.533114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bdf8d-382f-4835-a364-2cb3cd28e8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:53.533254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bdf8d-382f-4835-a364-2cb3cd28e8a3 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:53.534050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f1da9-d198-4635-8f15-75ab0182d771 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:53.539073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 165/321] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:53.543655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bdf8d-382f-4835-a364-2cb3cd28e8a3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:53.599008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98cc59-b8d0-4360-8ccb-af4d16c3864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:53.599864 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98cc59-b8d0-4360-8ccb-af4d16c3864b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:53.600310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98cc59-b8d0-4360-8ccb-af4d16c3864b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:53.600870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98cc59-b8d0-4360-8ccb-af4d16c3864b None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:53.601732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98cc59-b8d0-4360-8ccb-af4d16c3864b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:53.602238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98cc59-b8d0-4360-8ccb-af4d16c3864b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:53.604236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e98cc59-b8d0-4360-8ccb-af4d16c3864b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:53.617499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 157/322] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:43:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:53.618573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524f91-939c-4c1f-8543-5ff305f1c896 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:53.618855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524f91-939c-4c1f-8543-5ff305f1c896 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:53.619125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f524f91-939c-4c1f-8543-5ff305f1c896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:53.644863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2f524f91-939c-4c1f-8543-5ff305f1c896 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:53.646167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2f524f91-939c-4c1f-8543-5ff305f1c896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:53.722935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bdf8d-382f-4835-a364-2cb3cd28e8a3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:53.731667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:53.768524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 158/323] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:43:53.774413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524f91-939c-4c1f-8543-5ff305f1c896 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:53.794496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:53.795052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:53.795372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:53.796287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:53.797661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:53.799891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:53.802414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 166/324] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:53 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:53.808899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:53.875601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:53.962187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c272a8-ad69-4649-ad9a-d9e1a746637b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:53.976710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f524f91-939c-4c1f-8543-5ff305f1c896 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:54.022193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.023632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.024127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.024626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:54.026167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:54.027702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:54.035394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 167/325] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Oct 28 19:43:53 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:54.036465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:54.044477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.045609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.045997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.046466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:54.147291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:54.189521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:54.192671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:54.200329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe347db-5bb0-4d67-9325-f55a0f9e22bc None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:54.210871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:54.240092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.240793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.241062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.241338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:54.242266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] RBAC: Adding query filter params (group.id=d1ecca2f07a54002b3ffc24e1909b901, role.id=1df8c96377614e95b2f2fa089b4631f4, scope.project.id=770e1d8530dc4e2999324d107c6c436c) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:54.242579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:54.244127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:54.251101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 168/326] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Oct 28 19:43:54 2022] GET /identity/v3/role_assignments?group.id=d1ecca2f07a54002b3ffc24e1909b901&scope.project.id=770e1d8530dc4e2999324d107c6c436c&role.id=1df8c96377614e95b2f2fa089b4631f4 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:54.253608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:54.377751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 159/327] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:43:54.384221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:54.447290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f90c5-baba-40f4-a8fc-905c84e04be2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:54.504620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:54.515488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.516564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.517011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.519147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:54.538394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:43:54.546373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea976b-2fe1-4c47-b913-e96a4f833949 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:43:54.548363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:54.549288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:43:54.550132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:54.551090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 169/328] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:54.561492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:54.609043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.609750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.610058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.610306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] PATH_INFO: `/v3/projects/770e1d8530dc4e2999324d107c6c436c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:54.611658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] RBAC: Authorizing `identity:get_project(project_id=770e1d8530dc4e2999324d107c6c436c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:54.614108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:54.615534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:54.617634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 160/329] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:54 2022] GET /identity/v3/projects/770e1d8530dc4e2999324d107c6c436c => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:43:54.622117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:54.737947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c513943-f8af-433f-b300-01bb6c8ccd67 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:54.780545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.781195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.781525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.781803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:54.782512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:54.782891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:54.784400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:54.793950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 170/330] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:54.800538 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:54.802798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf3da0-da5c-447f-a0d7-5330b4cf8001 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:54.866343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.867354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.867751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.868145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] PATH_INFO: `/v3/groups/d1ecca2f07a54002b3ffc24e1909b901` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:54.870067 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] RBAC: Authorizing `identity:get_group(group_id=d1ecca2f07a54002b3ffc24e1909b901)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:54.872730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:54.881235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 161/331] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Oct 28 19:43:54 2022] GET /identity/v3/groups/d1ecca2f07a54002b3ffc24e1909b901 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:54.883169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:54.911403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:54.916089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:54.922621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcc9d6-d475-47d5-906b-997f343696d1 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:54.977568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:54.978242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:54.978545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:54.978880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:55.039677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b435bee-c20b-4b10-9038-6aa33fb64633 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:55.087925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:55.089874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:55.092605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:55.093436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:55.093808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:55.094181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:55.095055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] RBAC: Adding query filter params (group.id=d1ecca2f07a54002b3ffc24e1909b901, role.id=3b63b6b8ba3a43158d1be9fe4d2322d5, scope.project.id=770e1d8530dc4e2999324d107c6c436c) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:55.095520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:55.097084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:55.104575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 162/332] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Oct 28 19:43:54 2022] GET /identity/v3/role_assignments?group.id=d1ecca2f07a54002b3ffc24e1909b901&scope.project.id=770e1d8530dc4e2999324d107c6c436c&role.id=3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:55.217150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:55.230056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 171/333] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 28 19:43:55.236602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:55.371038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:55.396843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c1768-0afc-46b4-9869-606e6b86fb5a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:55.442239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:55.443236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:55.443676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:55.444126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] PATH_INFO: `/v3/projects/46afb98b47654c2ebe18eaaa061df1b1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:55.445925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] RBAC: Authorizing `identity:get_project(project_id=46afb98b47654c2ebe18eaaa061df1b1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:55.447727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:55.450815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 163/334] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:43:55 2022] GET /identity/v3/projects/46afb98b47654c2ebe18eaaa061df1b1 => generated 344 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:55.458526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:55.611238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2f80f-bfe2-4375-a616-01d89e2c2e7b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:55.651226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f957957-056d-4741-922f-7dcea49b138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:55.651868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f957957-056d-4741-922f-7dcea49b138e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:55.652180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f957957-056d-4741-922f-7dcea49b138e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:55.652523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f957957-056d-4741-922f-7dcea49b138e None admin] PATH_INFO: `/v3/groups/11a5fea29e0c47989c90f91d3908d0ad` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:55.653972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f957957-056d-4741-922f-7dcea49b138e None admin] RBAC: Authorizing `identity:get_group(group_id=11a5fea29e0c47989c90f91d3908d0ad)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:55.655595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f957957-056d-4741-922f-7dcea49b138e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:55.657351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 172/335] 10.222.0.52 () {56 vars in 1180 bytes} [Fri Oct 28 19:43:55 2022] GET /identity/v3/groups/11a5fea29e0c47989c90f91d3908d0ad => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:55.664962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:55.847135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa92a0-96a3-49b8-a2c5-fe8539fc3f99 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:55.909228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309693e-30f9-42cd-a40c-17872a694c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:55.910168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309693e-30f9-42cd-a40c-17872a694c47 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:55.910650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309693e-30f9-42cd-a40c-17872a694c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:55.911114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309693e-30f9-42cd-a40c-17872a694c47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:55.912422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309693e-30f9-42cd-a40c-17872a694c47 None admin] RBAC: Adding query filter params (group.id=11a5fea29e0c47989c90f91d3908d0ad, role.id=16542b0f593541a195074d7863391bd7, scope.project.id=46afb98b47654c2ebe18eaaa061df1b1) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:43:55.912947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309693e-30f9-42cd-a40c-17872a694c47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:55.916093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309693e-30f9-42cd-a40c-17872a694c47 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:55.927526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 164/336] 10.222.0.52 () {56 vars in 1376 bytes} [Fri Oct 28 19:43:55 2022] GET /identity/v3/role_assignments?group.id=11a5fea29e0c47989c90f91d3908d0ad&scope.project.id=46afb98b47654c2ebe18eaaa061df1b1&role.id=16542b0f593541a195074d7863391bd7 => generated 611 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:43:58.963348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe140-c8b9-44bf-9f01-84f437a1bd12 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:58.964419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe140-c8b9-44bf-9f01-84f437a1bd12 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:58.964915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fe140-c8b9-44bf-9f01-84f437a1bd12 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:58.967091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 173/337] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:58.974347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7a7b1-99ac-4418-bae8-9edb97a332d9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:58.975320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7a7b1-99ac-4418-bae8-9edb97a332d9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:58.975820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7a7b1-99ac-4418-bae8-9edb97a332d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:59.003613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-bfe7a7b1-99ac-4418-bae8-9edb97a332d9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:59.005349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bfe7a7b1-99ac-4418-bae8-9edb97a332d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:59.021134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:59.115037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 165/338] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:43:59.490672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fe140-c8b9-44bf-9f01-84f437a1bd12 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:59.618944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:43:59.687382 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c75d8-335b-4d26-82f6-a6c21b323f1f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:59.687915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c75d8-335b-4d26-82f6-a6c21b323f1f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:59.688328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c75d8-335b-4d26-82f6-a6c21b323f1f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:59.690469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 166/339] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:43:59.697029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f87fd-21c5-4f60-a4e9-36f640645a87 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:59.697304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f87fd-21c5-4f60-a4e9-36f640645a87 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:59.697764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f87fd-21c5-4f60-a4e9-36f640645a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:59.712722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fe140-c8b9-44bf-9f01-84f437a1bd12 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:43:59.757406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-642f87fd-21c5-4f60-a4e9-36f640645a87 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:43:59.759083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-642f87fd-21c5-4f60-a4e9-36f640645a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:43:59.813076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:43:59.814273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:43:59.814738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:43:59.815181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:43:59.855673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:43:59.861145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:43:59.900571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:43:59.901582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:43:59.902415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:43:59.902415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:43:59.902415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:43:59.908648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 174/340] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:43:59.918513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:43:59.947218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 167/341] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:00.131417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8ef79-9ca5-4bdf-b453-c0ca70b3e0d3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:00.159410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:00.202911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc3be7-8341-4f6f-ae32-4bd7bf59b5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:00.203965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3be7-8341-4f6f-ae32-4bd7bf59b5ec None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.204465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3be7-8341-4f6f-ae32-4bd7bf59b5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.204931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc3be7-8341-4f6f-ae32-4bd7bf59b5ec None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.206160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc3be7-8341-4f6f-ae32-4bd7bf59b5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:00.206662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc3be7-8341-4f6f-ae32-4bd7bf59b5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:00.209164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc3be7-8341-4f6f-ae32-4bd7bf59b5ec None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:00.233812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 175/342] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:00.240102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f87fd-21c5-4f60-a4e9-36f640645a87 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:00.392664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d9bf6-5b9f-40a4-8697-3c10df8e9590 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.393887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d9bf6-5b9f-40a4-8697-3c10df8e9590 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.395504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d9bf6-5b9f-40a4-8697-3c10df8e9590 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.400621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 176/343] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:00.400856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:00.406731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9750cc-dfc2-4192-a972-26c0b52b6c88 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.407040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9750cc-dfc2-4192-a972-26c0b52b6c88 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.407545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9750cc-dfc2-4192-a972-26c0b52b6c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.438457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f87fd-21c5-4f60-a4e9-36f640645a87 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:00.450306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ef9750cc-dfc2-4192-a972-26c0b52b6c88 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:00.451562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ef9750cc-dfc2-4192-a972-26c0b52b6c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:00.487039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:00.487687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.488079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.488358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.489140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:00.490717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:00.516521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 168/344] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:44:00 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:00.517904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:00.632905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 177/345] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:00.658712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c244-7201-4e72-a3b1-05a99aed7858 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:00.694405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5249e-a1ae-4eec-9dc3-04cf450197d5 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.694888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5249e-a1ae-4eec-9dc3-04cf450197d5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.695363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5249e-a1ae-4eec-9dc3-04cf450197d5 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.700510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 178/346] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:00.708770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:00.711496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9c255-b5ac-4c9a-bc21-3bbdbf1b960b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.711988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9c255-b5ac-4c9a-bc21-3bbdbf1b960b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.712356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9c255-b5ac-4c9a-bc21-3bbdbf1b960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.724709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:00.725764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.726184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.726604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.739939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:00.741727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:00.749828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1ae9c255-b5ac-4c9a-bc21-3bbdbf1b960b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:00.752113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1ae9c255-b5ac-4c9a-bc21-3bbdbf1b960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:00.768849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:00.770021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:00.771090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:00.771090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:00.771090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:00.771090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 169/347] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:00.776899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:00.854942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 179/348] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:00.856667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707c40b-73af-4bdc-ba20-3f2dc47437c9 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.857151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707c40b-73af-4bdc-ba20-3f2dc47437c9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.857620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707c40b-73af-4bdc-ba20-3f2dc47437c9 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.859671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 180/349] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:00.871418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc0a4-23d7-40c9-b7c2-cadf44554af0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:00.871996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc0a4-23d7-40c9-b7c2-cadf44554af0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:00.872439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc0a4-23d7-40c9-b7c2-cadf44554af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:00.927376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6f1cc0a4-23d7-40c9-b7c2-cadf44554af0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:00.929348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6f1cc0a4-23d7-40c9-b7c2-cadf44554af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:01.031671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:01.053527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4a134-f314-4bc4-beae-423c7cc7f387 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:01.099314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 181/350] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:44:01.100569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cc0a4-23d7-40c9-b7c2-cadf44554af0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:01.154705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:01.155759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:01.156262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:01.156728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:01.158073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:01.158650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:01.161464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:01.214020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 170/351] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:01.229686 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:01.281735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cc0a4-23d7-40c9-b7c2-cadf44554af0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:01.365090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:01.390681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:01.391732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:01.392281 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:01.392788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:01.394067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:01.396784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:01.412385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.sql.core [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 19:44:01.412385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 19:44:01.412385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [parameters: {'id': '5daa1e56bfa54829bec3f14640f852ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 19:44:01.412385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81545) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result.read() Oct 28 19:44:01.446019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return ref.to_dict() Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:44:01.447805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application yield resource Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise self.value Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application session.commit() Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:44:01.450005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:44:01.452863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:44:01.456049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application result.read() Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:44:01.460442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [parameters: {'id': '5daa1e56bfa54829bec3f14640f852ea', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:01.464225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 28 19:44:01.466881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:01.469712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 182/352] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Oct 28 19:44:01 2022] POST /identity/v3/roles => generated 144 bytes in 348 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:01.469712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:01.506572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:01.507418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aff602-9afc-4ccd-866c-42eaf710939e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:01.573612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:01.575158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:01.575506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:01.576026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:01.577871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:01.580136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:01.619376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c6e86-4ad9-44e5-9a97-b1d1941e4d87 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:01.625944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 171/353] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:44:01 2022] POST /identity/v3/users => generated 248 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:01.627470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:01.695555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:01.696861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:01.697407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:01.697984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:01.732633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:01.735722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:01.763408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:01.765423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:01.767440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:01.767440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:01.767440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:01.774563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 183/354] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:01.774563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:01.858416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:01.875262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1356d-2c34-4a67-828b-0405c00db257 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:01.945545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:01.946802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:01.947389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:01.947941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:01.960050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:01.969409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:01.980431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:01.982505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 28 19:44:01.984229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:01.986885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 172/355] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:01.991541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:01.996849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862134b5-04be-4aa9-84d3-38b92c540a11 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:02.069561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:02.073434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:02.073434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:02.073434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:02.096677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:02.099654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:02.130419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:02.132414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:02.134405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:02.134405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:02.134405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:02.141418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 184/356] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:02.143269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:02.191590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d7074-629e-43ee-9868-0c0d079b713b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:02.255438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:02.256486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:02.257139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:02.257724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:02.259028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:02.259673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:02.262373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:02.286189 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 173/357] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:02.287958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:02.325529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:02.377217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94940b3f-a85f-403e-9c9a-9b08c2749958 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:02.445228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:02.455137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:02.456121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:02.456582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:02.457066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:02.459105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:02.459610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:02.462536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:02.483459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 185/358] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:02.485582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:02.495307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad75c5b-4050-4d4a-9e62-f10a0370748b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:02.583851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:02.585799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:02.589553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:02.590661 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:02.592499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:02.595117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:02.600538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:02.643824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 174/359] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:02.656704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:02.720250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ec5a3-65eb-49e1-a2d6-6d5f311c1797 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:02.771346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b2f85-aa78-45dd-94b9-6ec3e179f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:02.772000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b2f85-aa78-45dd-94b9-6ec3e179f8bd None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:02.772279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b2f85-aa78-45dd-94b9-6ec3e179f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:02.772552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b2f85-aa78-45dd-94b9-6ec3e179f8bd None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:02.773801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b2f85-aa78-45dd-94b9-6ec3e179f8bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:02.775485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b2f85-aa78-45dd-94b9-6ec3e179f8bd None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:02.814738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 186/360] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:44:02 2022] POST /identity/v3/users => generated 248 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:02.868785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:02.922257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa56252-e72a-46f9-8d63-a9723b93f67c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:02.997413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f82b2-3836-4eb0-b66c-9d4e0e7bf327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:02.998521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f82b2-3836-4eb0-b66c-9d4e0e7bf327 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:02.999033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f82b2-3836-4eb0-b66c-9d4e0e7bf327 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:02.999509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f82b2-3836-4eb0-b66c-9d4e0e7bf327 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:03.000742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f82b2-3836-4eb0-b66c-9d4e0e7bf327 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:03.003741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f82b2-3836-4eb0-b66c-9d4e0e7bf327 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:03.051962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 175/361] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:44:02 2022] POST /identity/v3/users => generated 249 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:03.062420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76170-d446-4965-a69b-e9b8cb9e59e0 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:03.062947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76170-d446-4965-a69b-e9b8cb9e59e0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:03.063913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76170-d446-4965-a69b-e9b8cb9e59e0 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:03.067254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 187/362] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:03.074716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aee8a-15b7-4218-92c3-3f0738f1a5f9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:03.075305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aee8a-15b7-4218-92c3-3f0738f1a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:03.075778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972aee8a-15b7-4218-92c3-3f0738f1a5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:03.110669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-972aee8a-15b7-4218-92c3-3f0738f1a5f9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:03.112718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-972aee8a-15b7-4218-92c3-3f0738f1a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:03.251219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 176/363] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:03.543259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f76170-d446-4965-a69b-e9b8cb9e59e0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:03.615416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:03.683177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f76170-d446-4965-a69b-e9b8cb9e59e0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:03.744225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:03.744901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:03.745204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:03.745500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:03.760499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:03.765639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:03.767404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:03.768998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 188/364] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:03.778698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aee8a-15b7-4218-92c3-3f0738f1a5f9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:03.896298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:03.956196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972aee8a-15b7-4218-92c3-3f0738f1a5f9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:04.008067 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:04.008715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:04.008973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:04.009246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:04.009967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:04.010263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:04.011674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:04.025881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 177/365] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:04.032106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:04.217825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3efa3e-2d13-4e86-8748-813ff34168b8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:04.233723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:04.279864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:04.280536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:04.280809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:04.281081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:04.298292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:04.299812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:04.321886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:04.325285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:04.329256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:04.329256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:04.329256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:04.329256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 189/366] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:04.330097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:04.486354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05c2e8-0c67-45bb-9b07-2b65676b4c69 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:04.521305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:04.535545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:04.536174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:04.536447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:04.536716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:04.537371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:04.537693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:04.539087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:04.560809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 178/367] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:04.566684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:04.727264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585acc5-c9ba-4dfd-9841-18f0e92fc354 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:04.788047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9774a9-48ce-4f76-95e6-71d9d578923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:04.788612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9774a9-48ce-4f76-95e6-71d9d578923b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:04.788885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9774a9-48ce-4f76-95e6-71d9d578923b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:04.789151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9774a9-48ce-4f76-95e6-71d9d578923b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:04.798235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9774a9-48ce-4f76-95e6-71d9d578923b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:04.799727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9774a9-48ce-4f76-95e6-71d9d578923b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-0b9774a9-48ce-4f76-95e6-71d9d578923b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:04.815201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:04.816162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:04.818304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 190/368] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Oct 28 19:44:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:04.822452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:04.887106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6190b-95a3-4a89-a3c6-e83c395bf845 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:04.887440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6190b-95a3-4a89-a3c6-e83c395bf845 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:04.887654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6190b-95a3-4a89-a3c6-e83c395bf845 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:04.889046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 191/369] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:44:04.896106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032b46-688c-456a-8e3a-127749033c84 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:04.896454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032b46-688c-456a-8e3a-127749033c84 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:04.896652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032b46-688c-456a-8e3a-127749033c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:04.927513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-07032b46-688c-456a-8e3a-127749033c84 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:04.928805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-07032b46-688c-456a-8e3a-127749033c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:04.977800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:05.001803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a383b-3359-4312-9234-c8b454a99f78 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:05.051378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:05.051996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:05.052303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:05.052572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:05.053405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:05.053748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:05.055223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:05.099023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 179/370] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Oct 28 19:44:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:05.104970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:05.127925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 192/371] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:44:05.175004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:05.225323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15f0aa-5f6a-49c9-b0f3-5f20532bbbd3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:05.265300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:05.265981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:05.266255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:05.266524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:05.278801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:05.280325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:05.297651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:05.298709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:05.299607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:05.299607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:05.299607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:05.299607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 180/372] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:05.304997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07032b46-688c-456a-8e3a-127749033c84 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:05.496792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07032b46-688c-456a-8e3a-127749033c84 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:05.555933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:05.556938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:05.557424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:05.557883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:05.558769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:05.559289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:05.560973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:05.564620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:05.583052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 193/373] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:05.590194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:05.621909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:05.773579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:05.780834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05d1f7-bddf-4bae-935d-84a5e5cd13db None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:05.811726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bbb19-fe94-4c27-9053-a0c2304ef0ef None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:05.822394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead7838-7eaf-49ae-983f-528208039499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:05.823045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead7838-7eaf-49ae-983f-528208039499 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:05.823597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead7838-7eaf-49ae-983f-528208039499 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:05.823597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead7838-7eaf-49ae-983f-528208039499 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:05.838190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead7838-7eaf-49ae-983f-528208039499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1ead7838-7eaf-49ae-983f-528208039499 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:05.843557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:05.844534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:05.845431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 181/374] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:05.849166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45974b-4157-4789-83ae-688c34044758 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:05.849166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45974b-4157-4789-83ae-688c34044758 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:05.849166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45974b-4157-4789-83ae-688c34044758 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:05.853688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 182/375] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:05.854696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45974b-4157-4789-83ae-688c34044758 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:05.900254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86596193-615a-47a2-aabe-c83c1dbc6548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:05.901304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596193-615a-47a2-aabe-c83c1dbc6548 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:05.901809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596193-615a-47a2-aabe-c83c1dbc6548 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:05.902295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86596193-615a-47a2-aabe-c83c1dbc6548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:05.911509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86596193-615a-47a2-aabe-c83c1dbc6548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:05.913473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86596193-615a-47a2-aabe-c83c1dbc6548 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-86596193-615a-47a2-aabe-c83c1dbc6548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:05.927640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:05.928573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:05.929427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:05.932254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 194/376] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:05.939000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019f676-e982-48c9-a51a-a4b7df51beaa None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:05.939598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019f676-e982-48c9-a51a-a4b7df51beaa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:05.940082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019f676-e982-48c9-a51a-a4b7df51beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:05.961239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a019f676-e982-48c9-a51a-a4b7df51beaa None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:05.963089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a019f676-e982-48c9-a51a-a4b7df51beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:06.057262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45974b-4157-4789-83ae-688c34044758 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:06.077825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 195/377] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:06.079253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019f676-e982-48c9-a51a-a4b7df51beaa None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:06.089424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:06.132811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7690bb-a8fd-43dc-b4e4-7517d6e0f083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:06.133820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7690bb-a8fd-43dc-b4e4-7517d6e0f083 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.134281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7690bb-a8fd-43dc-b4e4-7517d6e0f083 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.134727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7690bb-a8fd-43dc-b4e4-7517d6e0f083 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.135826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7690bb-a8fd-43dc-b4e4-7517d6e0f083 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:06.136396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7690bb-a8fd-43dc-b4e4-7517d6e0f083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:06.138604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7690bb-a8fd-43dc-b4e4-7517d6e0f083 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:06.153567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 183/378] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:06.155705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b47bf-75a8-478b-bbbd-f43f172787ed None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.156154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b47bf-75a8-478b-bbbd-f43f172787ed None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.156678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b47bf-75a8-478b-bbbd-f43f172787ed None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.161005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 184/379] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:06.161005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b47bf-75a8-478b-bbbd-f43f172787ed None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:06.199591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:06.307663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019f676-e982-48c9-a51a-a4b7df51beaa None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:06.368026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b47bf-75a8-478b-bbbd-f43f172787ed None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:06.369548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1000e-48a5-4e24-88e7-f7d565148097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:06.370528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1000e-48a5-4e24-88e7-f7d565148097 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.370981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1000e-48a5-4e24-88e7-f7d565148097 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.371432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1000e-48a5-4e24-88e7-f7d565148097 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.372757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1000e-48a5-4e24-88e7-f7d565148097 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:06.373266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1000e-48a5-4e24-88e7-f7d565148097 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:06.376151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1000e-48a5-4e24-88e7-f7d565148097 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:06.413789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 196/380] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:06.413789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08a7b-9e24-4054-b54e-62c45ff4fa76 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.413789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08a7b-9e24-4054-b54e-62c45ff4fa76 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.413789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d08a7b-9e24-4054-b54e-62c45ff4fa76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.435956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:06.436618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.436895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.437165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.439261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e7d08a7b-9e24-4054-b54e-62c45ff4fa76 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:06.441023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e7d08a7b-9e24-4054-b54e-62c45ff4fa76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:06.450538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:06.452054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:06.471943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:06.474318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:06.476077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:06.476077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:06.476077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:06.477939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 185/381] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:06.479180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:06.519418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:06.535392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 197/382] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:06.538477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d08a7b-9e24-4054-b54e-62c45ff4fa76 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:06.598269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:06.659417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced83dc6-6189-450c-a507-5585acd726f8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:06.667290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d08a7b-9e24-4054-b54e-62c45ff4fa76 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:06.701890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:06.702540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.703071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.703185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.715873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:06.717562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:06.733769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e55e3-f87d-40a2-b43c-38c04698a772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:06.734888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e55e3-f87d-40a2-b43c-38c04698a772 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.735390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e55e3-f87d-40a2-b43c-38c04698a772 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.735865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e55e3-f87d-40a2-b43c-38c04698a772 None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/8e5bd5f8509b414c8699ec51117745cb/roles/397543bbcaeb4ccfb989c8a046f27b2f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:06.737213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:06.738106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:06.738929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:06.738929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:06.738929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:06.738929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 186/383] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:06.739681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:06.768003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e55e3-f87d-40a2-b43c-38c04698a772 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=8e5bd5f8509b414c8699ec51117745cb, role_id=397543bbcaeb4ccfb989c8a046f27b2f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:06.771045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e55e3-f87d-40a2-b43c-38c04698a772 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:06.805370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 198/384] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:06 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/8e5bd5f8509b414c8699ec51117745cb/roles/397543bbcaeb4ccfb989c8a046f27b2f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:06.805370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d595-de2c-4c81-874b-d794965cf169 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.805370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d595-de2c-4c81-874b-d794965cf169 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.805370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef90d595-de2c-4c81-874b-d794965cf169 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.805370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 199/385] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:06.805370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d595-de2c-4c81-874b-d794965cf169 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:06.892979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:06.913070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8124a-d0ec-4d93-bbb6-2602e2b64f32 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:06.955062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:06.981261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef90d595-de2c-4c81-874b-d794965cf169 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:06.985313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c38cbe-2af1-4a79-90c7-e67c4cc31bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:06.986495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38cbe-2af1-4a79-90c7-e67c4cc31bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:06.986977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38cbe-2af1-4a79-90c7-e67c4cc31bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:06.987545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c38cbe-2af1-4a79-90c7-e67c4cc31bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:06.988959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38cbe-2af1-4a79-90c7-e67c4cc31bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:06.989527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38cbe-2af1-4a79-90c7-e67c4cc31bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:06.992685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c38cbe-2af1-4a79-90c7-e67c4cc31bb3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:07.010376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 187/386] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:07.011537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad96e3-07ad-4369-aac4-41b6bd40b5fd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.012098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad96e3-07ad-4369-aac4-41b6bd40b5fd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.012389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcad96e3-07ad-4369-aac4-41b6bd40b5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.030938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:07.031685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.031952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.032399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.033062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:07.033362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:07.033934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-dcad96e3-07ad-4369-aac4-41b6bd40b5fd None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:07.034807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:07.035160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dcad96e3-07ad-4369-aac4-41b6bd40b5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:07.048592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 200/387] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:07.049508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:07.122949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 188/388] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:07.123976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad96e3-07ad-4369-aac4-41b6bd40b5fd None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:07.238078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b970b50-80f6-4c18-a0a2-1d9d55e04b98 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:07.243084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:07.250272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcad96e3-07ad-4369-aac4-41b6bd40b5fd None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:07.268880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:07.303809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:07.304624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.304994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.305357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.309261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:07.310358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.310834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.311310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.315416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:07.317634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:07.332084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:07.335058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:44:07.338158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:07.349917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:07.350163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 201/389] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:07.350163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:07.351031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:07.354161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:07.356331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 189/390] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:07.365460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:07.528026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9163d-fd3b-40e8-b305-4a2caeae49c4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:07.562526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd08cf-6536-4a44-bb01-d52c1da9d9dd None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:07.587834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:07.589733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.590516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.592252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.594329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:07.598603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:07.628969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:07.630004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.630476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.630935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.632225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:07.632728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:07.635210 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:07.643202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 202/391] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:44:07 2022] POST /identity/v3/users => generated 247 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:07.645172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:07.668031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 190/392] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Oct 28 19:44:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:07.669706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:07.710960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:07.727850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:07.884272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e346cb-60aa-4035-ab5a-5ca412ee1c29 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:07.914169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374baee-08f5-44d8-9c94-97b65b222007 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:07.969705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:07.970905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.971244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.971693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.988334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:07.989447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:07.990180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:07.990361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:07.991516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:07.992807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:07.992976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:07.994464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:08.001773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:08.003529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:08.005164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 191/393] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:08.008227 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:08.015463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 203/394] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:08.018421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:08.160022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:08.194501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:08.204776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d33575-c44a-43ce-a729-e1f64f05f84b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:08.221782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94648d3d-b812-45b7-a0e7-b56c60542687 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:08.273181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:08.274298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:08.274776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:08.275472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:08.276615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:08.277191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:08.280090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:08.296583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 204/395] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:08.304430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:08.306309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:08.307363 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:08.307832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:08.308297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:08.337302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:08.340355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:08.373116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:08.374948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:08.376465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:08.376465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:08.376465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:08.381063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 192/396] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:08.389728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:08.516291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b34ea8-6469-4d2d-9018-846fe8d79d41 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:08.584844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:08.585865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:08.586438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:08.586994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:08.607636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:08.611227 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:08.614789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:08.619314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfa6ed-8e24-4ab1-b6b8-0b55a17de078 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:08.645301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:08.647332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:08.649557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:08.649557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:08.649557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:08.657589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 205/397] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:08.659292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:08.698680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:08.700066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:08.700740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:08.701492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:08.721725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:08.728919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:08.732452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:08.763102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:08.765116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:08.766999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:08.766999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:08.766999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:08.773853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 193/398] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:08.775852 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:08.884213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2908c-0e6f-4f17-adcc-49f012f9722e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:08.961938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:08.963303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:08.963848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:08.964405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:08.966399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:08.966687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:08.969691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.006852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 206/399] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:09.007551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.028368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f42d3-cbad-4e62-baff-9620a8364527 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:09.074653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:09.076407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.076956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.077760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.078666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:09.079233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:09.080907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.096469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 194/400] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:09.097737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.133295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:09.178661 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:09.230947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fca3f-deab-44dc-8152-b7e441b3585d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:09.244338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67571d-fd58-422e-9900-ec23e2d4f860 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:09.295829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:09.296795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.297280 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.297861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.304349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:09.305490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.306029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.306466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.307645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:09.308018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:09.308132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:09.309900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.310916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:09.325644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:09.326579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:09.327403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:09.327803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 195/401] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:09.334447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.339860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 207/402] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:09.341469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.489305 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda917b-fe39-4158-a0c5-17052efb24ac None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:09.506444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:09.520111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa261-c97d-4709-bdff-f3bef1e70511 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:09.533248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:09.533911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.534189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.534461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.535189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:09.535488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:09.537018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.538103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:09.554091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 208/403] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:09.554611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.570349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d7fd-b4d5-4264-b00e-b4f84593f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:09.571007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d7fd-b4d5-4264-b00e-b4f84593f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.571274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d7fd-b4d5-4264-b00e-b4f84593f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.571543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d7fd-b4d5-4264-b00e-b4f84593f7f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.581028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d7fd-b4d5-4264-b00e-b4f84593f7f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:09.582557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d7fd-b4d5-4264-b00e-b4f84593f7f4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7290d7fd-b4d5-4264-b00e-b4f84593f7f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:09.597801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:09.604881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 196/404] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e823-acd5-4b4c-be19-19ceeb99c2fb None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.609646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e823-acd5-4b4c-be19-19ceeb99c2fb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.611170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4e823-acd5-4b4c-be19-19ceeb99c2fb None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.611170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 197/405] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:09.611170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4e823-acd5-4b4c-be19-19ceeb99c2fb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.713500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a7383-f2f4-460e-82a1-d17e7de11232 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:09.769349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2a708-eb81-4757-ab11-0ce68bbc78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:09.770313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a708-eb81-4757-ab11-0ce68bbc78f4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.771192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a708-eb81-4757-ab11-0ce68bbc78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.771192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2a708-eb81-4757-ab11-0ce68bbc78f4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.782147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a708-eb81-4757-ab11-0ce68bbc78f4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:09.784080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2a708-eb81-4757-ab11-0ce68bbc78f4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.786720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4e823-acd5-4b4c-be19-19ceeb99c2fb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4ca2a708-eb81-4757-ab11-0ce68bbc78f4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:09.800065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:09.802253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 209/406] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874e2f-8af9-42c2-b6f7-7f26a177bcfa None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.804411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874e2f-8af9-42c2-b6f7-7f26a177bcfa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.806566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874e2f-8af9-42c2-b6f7-7f26a177bcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.824093 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-28874e2f-8af9-42c2-b6f7-7f26a177bcfa None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:09.825323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-28874e2f-8af9-42c2-b6f7-7f26a177bcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:09.863147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:09.867360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:09.868573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:09.869033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:09.869532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/237bbe3771c249449b4c2cad20fa5ce4/roles/397543bbcaeb4ccfb989c8a046f27b2f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:09.895987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=237bbe3771c249449b4c2cad20fa5ce4, role_id=397543bbcaeb4ccfb989c8a046f27b2f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:09.899128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:09.925419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 198/407] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:09 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/237bbe3771c249449b4c2cad20fa5ce4/roles/397543bbcaeb4ccfb989c8a046f27b2f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:09.925419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.933906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 210/408] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:09.935477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28874e2f-8af9-42c2-b6f7-7f26a177bcfa None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:09.976434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:10.168647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdcc9c2-ed81-405f-bc46-dc1e66ca660b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:10.290499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:10.292027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:10.293030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:10.295264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:10.297169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:10.298054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:10.301084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:10.313579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28874e2f-8af9-42c2-b6f7-7f26a177bcfa None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:10.345502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 199/409] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Oct 28 19:44:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:10.352587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:10.408754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:10.410379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:10.411136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:10.411851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:10.413545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:10.414343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:10.418002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:10.499558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 211/410] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Oct 28 19:44:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 565 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:10.500488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:10.529781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:10.574231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:10.611955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22697638-999f-4c3e-9045-f6370671bf5c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:10.657273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:10.657957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:10.658229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:10.658499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:10.660006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164e4be5-4c54-41c8-96e2-3422a1f13155 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:10.671918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:10.674078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:10.694650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:10.696222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:10.697960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:10.697960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:10.697960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:10.700624 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 200/411] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:10.701688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:10.755730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:10.757209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:10.757966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:10.758616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:10.780682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:10.790588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:10.792511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:10.794241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:10.797902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 212/412] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:10.799744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:10.858827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70c5c08-8779-41a6-be05-e245f2b7e8ea None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:10.896408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:10.906555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:10.908476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:10.909170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:10.909850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:10.935407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:10.937480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:10.946757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:10.964752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:10.966872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:10.968673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:10.968673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:10.968673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:10.968673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 201/413] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:10.968673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:10.977074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5545a-87a2-4112-be19-fd7e1213a4bf None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:11.036011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9158edc-0d0d-4042-bd83-9f062ea4386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:11.036852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9158edc-0d0d-4042-bd83-9f062ea4386a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.037303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9158edc-0d0d-4042-bd83-9f062ea4386a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.037774 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9158edc-0d0d-4042-bd83-9f062ea4386a None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.039588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9158edc-0d0d-4042-bd83-9f062ea4386a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:11.040081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9158edc-0d0d-4042-bd83-9f062ea4386a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:11.043107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9158edc-0d0d-4042-bd83-9f062ea4386a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:11.065925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 213/414] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:11.069087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95969ceb-74be-436c-a209-04bbfa373e4d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.070150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95969ceb-74be-436c-a209-04bbfa373e4d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.070864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95969ceb-74be-436c-a209-04bbfa373e4d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.073746 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 214/415] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:11.075102 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95969ceb-74be-436c-a209-04bbfa373e4d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:11.145041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6715e-1ce5-4a2c-b656-17b5e4e690bf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:11.214232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:11.215275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.215734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.216183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.217326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:11.217870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:11.221062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:11.239721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 202/416] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:11.241107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:11.256405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95969ceb-74be-436c-a209-04bbfa373e4d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:11.313955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6896b0-fba7-4fac-b276-410f1dee9e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:11.314805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6896b0-fba7-4fac-b276-410f1dee9e56 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.315258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6896b0-fba7-4fac-b276-410f1dee9e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.315706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6896b0-fba7-4fac-b276-410f1dee9e56 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.316810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6896b0-fba7-4fac-b276-410f1dee9e56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:11.317304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6896b0-fba7-4fac-b276-410f1dee9e56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:11.319462 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6896b0-fba7-4fac-b276-410f1dee9e56 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:11.328482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:11.345155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 215/417] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:11.345155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdba5ee-ccd2-48b9-96b5-6bfb6e50b0af None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.345155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdba5ee-ccd2-48b9-96b5-6bfb6e50b0af None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.345155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdba5ee-ccd2-48b9-96b5-6bfb6e50b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.350478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:11.370236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-abdba5ee-ccd2-48b9-96b5-6bfb6e50b0af None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:11.372126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-abdba5ee-ccd2-48b9-96b5-6bfb6e50b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:11.445239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b678a5-264f-496c-bbf3-210128f90b4d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:11.491710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 216/418] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:11.493084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdba5ee-ccd2-48b9-96b5-6bfb6e50b0af None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:11.521346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:11.522736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.523167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.523594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.535430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:11.538007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:11.557796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:11.559441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 203/419] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:11.562071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:11.709140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdba5ee-ccd2-48b9-96b5-6bfb6e50b0af None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:11.753826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3c2fe-9244-41d9-ac0e-ea0b785876cc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:11.768102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:11.786759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:11.796702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:11.798278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.798690 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.799086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.818810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:11.821317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:11.831468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:11.832965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:11.833762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:11.834659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:11.847058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:11.849733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:11.850359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:11.851948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:11.854680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:11.854680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:11.854680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:11.861896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 217/420] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:11.863807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:11.873631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:11.875324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:11.877071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 204/421] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:11.878619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:12.027137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ba45f-22f9-49c9-8938-4cbe38f85925 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.068201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:12.069066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:12.069529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:12.069988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:12.070841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:12.071276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:12.073042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:12.095258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 218/422] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:12.095258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:12.106030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69d6b9-11b7-4b45-b02b-2a595a23ee74 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.161540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:12.163370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:12.163998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:12.164273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:12.164544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:12.165203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:12.165531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:12.167337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:12.183123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 205/423] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:12.184079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:12.223170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:12.280879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb995f-050f-4341-b67b-e001bcb25038 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.325293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8089-d4a2-47cb-8a13-e27fc229586f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.343921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:12.344990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:12.345520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:12.346083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:12.347376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:12.347933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:12.350642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:12.369193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:12.369880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:12.370156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:12.370423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:12.382006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 219/424] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:12.383744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:12.384486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:12.388815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:12.390868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 206/425] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:12.393073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:12.562803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ba01-f547-4077-b849-9665fc3bc3d0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.567229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:12.568615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:12.599235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2848d-d4fb-4525-a4f2-b65b4826efd5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.618432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:12.619371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:12.619827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:12.620247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/e609d787cb964803b2630895f155a2c5/roles/397543bbcaeb4ccfb989c8a046f27b2f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:12.642099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=e609d787cb964803b2630895f155a2c5, role_id=397543bbcaeb4ccfb989c8a046f27b2f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:12.644064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:12.670640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:12.671534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:12.671936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:12.672329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:12.677516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 220/426] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:12 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/e609d787cb964803b2630895f155a2c5/roles/397543bbcaeb4ccfb989c8a046f27b2f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:12.679263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:12.685410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:12.690447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:12.725942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:12.727741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:12.730258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:12.736174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 207/427] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Oct 28 19:44:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:12.738434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:12.924409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab8dcf-89d3-42d4-b22e-9978ed252288 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.973697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302cc6-5782-4410-b369-38cef7cb1fc0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:12.989877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:12.990876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:12.991289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:12.991737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/7157e60fb6fb4b84866ce59f051a9037/roles/397543bbcaeb4ccfb989c8a046f27b2f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:13.013535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=7157e60fb6fb4b84866ce59f051a9037, role_id=397543bbcaeb4ccfb989c8a046f27b2f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:13.015754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:13.035429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 221/428] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:12 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/7157e60fb6fb4b84866ce59f051a9037/roles/397543bbcaeb4ccfb989c8a046f27b2f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:13.037223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bfcef-be22-4dda-9654-673956156cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:13.037487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:13.038820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bfcef-be22-4dda-9654-673956156cbe None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:13.039515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bfcef-be22-4dda-9654-673956156cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:13.040201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bfcef-be22-4dda-9654-673956156cbe None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:13.050656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:13.051532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bfcef-be22-4dda-9654-673956156cbe None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:13.052486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bfcef-be22-4dda-9654-673956156cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:13.055556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390bfcef-be22-4dda-9654-673956156cbe None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:13.075424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 208/429] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:13.080384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a7cf-e01b-4c3b-807d-bc85fac70d9a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:13.080384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a7cf-e01b-4c3b-807d-bc85fac70d9a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:13.080384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550a7cf-e01b-4c3b-807d-bc85fac70d9a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:13.080384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 209/430] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:13.088979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a7cf-e01b-4c3b-807d-bc85fac70d9a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:13.105985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:13.239248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550a7cf-e01b-4c3b-807d-bc85fac70d9a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:13.308248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9f848-d0a8-4ca0-b3dd-e9925d7a3557 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:13.314631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d64a990-0ddd-4a4b-ab4e-a71b717def12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:13.315767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64a990-0ddd-4a4b-ab4e-a71b717def12 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:13.316238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64a990-0ddd-4a4b-ab4e-a71b717def12 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:13.316877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d64a990-0ddd-4a4b-ab4e-a71b717def12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:13.336400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64a990-0ddd-4a4b-ab4e-a71b717def12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:13.338900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d64a990-0ddd-4a4b-ab4e-a71b717def12 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1d64a990-0ddd-4a4b-ab4e-a71b717def12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:13.365571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:13.367462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:13.369241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:13.369241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:13.369241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:13.369241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 210/431] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:13.369893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ecbd-9802-4b1a-a9be-620bb45ce257 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:13.370359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ecbd-9802-4b1a-a9be-620bb45ce257 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:13.373497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ecbd-9802-4b1a-a9be-620bb45ce257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:13.402567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1cb8ecbd-9802-4b1a-a9be-620bb45ce257 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:13.404055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:13.404435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1cb8ecbd-9802-4b1a-a9be-620bb45ce257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:13.405288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:13.405875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:13.406468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:13.408133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:13.408754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:13.411192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:13.444986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 222/432] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Oct 28 19:44:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:13.446625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:13.533582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:13.541881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 211/433] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:13.543849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ecbd-9802-4b1a-a9be-620bb45ce257 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:13.566325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:13.678967 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae545578-3265-4dde-9eb9-5b8a70081046 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:13.788001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:13.788962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:13.789466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:13.789937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:13.791047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:13.791568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:13.794128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:13.820809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ecbd-9802-4b1a-a9be-620bb45ce257 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:13.834284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 223/434] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:13.844047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:13.947694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:13.948689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:13.949182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:13.951372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:14.111238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:14.116447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d959c-5aac-403a-9df8-6fb8b383c416 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:14.136075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:14.138913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:14.176130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:14.207330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:14.208883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:14.210101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:14.210862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:14.230148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:14.233780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:14.261358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:14.263042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:14.264730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 224/435] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:14.265840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:14.374995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 212/436] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 832 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:14.378496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:14.484857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d4e3-d645-40e6-8edb-f9d272cd8990 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:14.553947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:14.555525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:14.556127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:14.556749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:14.579116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:14.582805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:14.591954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:14.593769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:14.595205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:14.600277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 225/437] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:14.602321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:14.614952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e79cbb-0ae6-4f09-b1df-46e613415853 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:14.687755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:14.688869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:14.689326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:14.689957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:14.691328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:14.691790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:14.693363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:14.695975 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:14.734275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 213/438] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Oct 28 19:44:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:14.735914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:14.816109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d9d48-9f32-46c9-a428-954331915535 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:14.880339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:14.881702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:14.882207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:14.882648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:14.898081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:14.900563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:14.921177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:14.922146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:14.923033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:14.923033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:14.923033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:14.924923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 226/439] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:14.926119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:14.955234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8dded-2359-44a2-b4c3-0cf637778f52 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.048225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.051100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.052011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.052650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.055288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:15.056445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.058015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:15.058700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.071218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 214/440] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:15.076532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.084128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e05bb-f3be-4e2f-80cc-144b588a8e34 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.099245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:15.136735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.137601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.137750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.137974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.151233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.152808 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:15.181511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:15.183447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:15.185355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:15.185355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:15.185355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:15.188080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 227/441] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:15.189051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.277369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35889eaf-daef-4e65-8ff3-d9998c57bf3e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.316524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.317061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.317342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.317636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.318292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:15.318594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.320023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.334274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 215/442] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:15.339862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.374252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35ba85-b14c-4851-99b2-73b67f16c43a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.416042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.417114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.417624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.418089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.427267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:15.436376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.439765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.453188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:15.465761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5577c9-a256-4475-9cbf-0bb160fab6e3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:15.473515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:15.475282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:15.476945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:15.476945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:15.476945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:15.488169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 228/443] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:15.490292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.508311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.508595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.508785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.508910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.509637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:15.509938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.511398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.526887 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 216/444] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:15.528058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.645466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb511-819c-4ea1-ad1e-e8f761d8b211 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.682989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:15.691690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.692374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.692699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.692974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.694162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:15.694162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.695511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.699934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576c1a-f8c8-4dcb-af95-21daafc9ff2c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.717284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 217/445] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:15.717284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.775294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.776823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.777648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.778389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.791873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.795129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:15.818249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:15.819927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:15.822278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:15.825535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 229/446] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:15.827389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.848576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f479d6-df92-4acc-9f51-8997c10f1819 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:15.891347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:15.892030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:15.892313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:15.892777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:15.901726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:15.903287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:15.917098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:15.918804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 218/447] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:15.920465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:15.960248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:15.987939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:16.049851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05bd71-399b-445c-94d0-ef03bc9950d5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:16.062061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844125-ac08-4580-9dd4-a53c93bbf2ae None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:16.088336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:16.089015 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.089289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.089607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.090321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:16.090625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:16.092183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:16.113509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 219/448] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:16.114628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:16.133198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bd1e7-3b5c-4e17-8480-efab192a37dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:16.134884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd1e7-3b5c-4e17-8480-efab192a37dd None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.135640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd1e7-3b5c-4e17-8480-efab192a37dd None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.136187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd1e7-3b5c-4e17-8480-efab192a37dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.151170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bd1e7-3b5c-4e17-8480-efab192a37dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:16.154042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5bd1e7-3b5c-4e17-8480-efab192a37dd None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-bc5bd1e7-3b5c-4e17-8480-efab192a37dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:16.177868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:16.178841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 28 19:44:16.179783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:16.180293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 230/449] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:16.182053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aba06-eda3-4603-a53a-e4eecf826d02 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.182536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aba06-eda3-4603-a53a-e4eecf826d02 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.182981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9aba06-eda3-4603-a53a-e4eecf826d02 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.189464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 231/450] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:16.189464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aba06-eda3-4603-a53a-e4eecf826d02 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:16.256915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee8c57-d353-475f-b2b9-1839f58b6646 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:16.280750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:16.324223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:16.324977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.325134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.325477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.326099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:16.326391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:16.327876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:16.328771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9aba06-eda3-4603-a53a-e4eecf826d02 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:16.346810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 220/451] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:16.347815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:16.356005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:16.379796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa8c6-1dbf-4e9c-98e0-b012fe1ddd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:16.380522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa8c6-1dbf-4e9c-98e0-b012fe1ddd07 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.380897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa8c6-1dbf-4e9c-98e0-b012fe1ddd07 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.381252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa8c6-1dbf-4e9c-98e0-b012fe1ddd07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.382578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa8c6-1dbf-4e9c-98e0-b012fe1ddd07 None admin] RBAC: Adding query filter params (role.id=397543bbcaeb4ccfb989c8a046f27b2f, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=8e5bd5f8509b414c8699ec51117745cb) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:16.383068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa8c6-1dbf-4e9c-98e0-b012fe1ddd07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:16.385646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa8c6-1dbf-4e9c-98e0-b012fe1ddd07 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:16.394180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 232/452] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:16 2022] GET /identity/v3/role_assignments?user.id=8e5bd5f8509b414c8699ec51117745cb&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=397543bbcaeb4ccfb989c8a046f27b2f => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:16.395790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28998c5-4892-4feb-993f-7d11e5b24ead None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.396287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28998c5-4892-4feb-993f-7d11e5b24ead None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.396713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28998c5-4892-4feb-993f-7d11e5b24ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.431145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d28998c5-4892-4feb-993f-7d11e5b24ead None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:16.432857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d28998c5-4892-4feb-993f-7d11e5b24ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:16.509808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412769d-dea3-4379-9617-264e5354de7c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:16.541501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 233/453] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:16.541501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28998c5-4892-4feb-993f-7d11e5b24ead None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:16.575660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef8ac8-874f-4100-aa01-c320658c0b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:16.577167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef8ac8-874f-4100-aa01-c320658c0b76 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.578022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef8ac8-874f-4100-aa01-c320658c0b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.579112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef8ac8-874f-4100-aa01-c320658c0b76 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.581163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef8ac8-874f-4100-aa01-c320658c0b76 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:16.581992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef8ac8-874f-4100-aa01-c320658c0b76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:16.585519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef8ac8-874f-4100-aa01-c320658c0b76 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:16.622401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 221/454] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Oct 28 19:44:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:16.625108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4326-254a-4595-af67-acc5e0fb12b5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.625993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4326-254a-4595-af67-acc5e0fb12b5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.626822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc4326-254a-4595-af67-acc5e0fb12b5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.630287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 222/455] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:16.634122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4326-254a-4595-af67-acc5e0fb12b5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:16.690977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:16.756287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28998c5-4892-4feb-993f-7d11e5b24ead None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:16.791262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:16.843309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc4326-254a-4595-af67-acc5e0fb12b5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:16.851669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb94cc1-c144-4273-a7b9-59701458e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:16.853243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94cc1-c144-4273-a7b9-59701458e11f None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.854099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94cc1-c144-4273-a7b9-59701458e11f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.854820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94cc1-c144-4273-a7b9-59701458e11f None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/5eb5a6ff4af64a9980bcaa49f3c97bba/roles/397543bbcaeb4ccfb989c8a046f27b2f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.887049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb94cc1-c144-4273-a7b9-59701458e11f None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=5eb5a6ff4af64a9980bcaa49f3c97bba, role_id=397543bbcaeb4ccfb989c8a046f27b2f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:16.890740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb94cc1-c144-4273-a7b9-59701458e11f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:16.912534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:16.914101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.914669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.915161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.919612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 234/456] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:16 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/5eb5a6ff4af64a9980bcaa49f3c97bba/roles/397543bbcaeb4ccfb989c8a046f27b2f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:16.922558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778acbfb-9a30-468f-be5e-6511d18021d3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:16.923385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778acbfb-9a30-468f-be5e-6511d18021d3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:16.924065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778acbfb-9a30-468f-be5e-6511d18021d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:16.960757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-778acbfb-9a30-468f-be5e-6511d18021d3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:16.963462 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-778acbfb-9a30-468f-be5e-6511d18021d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:17.118726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:17.121582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:17.139059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 235/457] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:17.140398 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778acbfb-9a30-468f-be5e-6511d18021d3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:17.185831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:17.266987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:17.271332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778acbfb-9a30-468f-be5e-6511d18021d3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:17.317364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:17.318677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:17.319164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:17.320041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:17.342878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 223/458] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:17.351430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:17.353641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:17.365050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:17.366068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:17.366850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:17.377580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 236/459] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:17.397609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:17.613018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05618bfe-7be7-4829-b62e-e63d762dd9fc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:17.709123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:17.727706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9d52c-9fb7-4130-a0c0-914e7479b134 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:17.735307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:17.736400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:17.736871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:17.737343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:17.758626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:17.761420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:17.794758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:17.795156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:17.796019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:17.796835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:17.796835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:17.796835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:17.797000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:17.797000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:17.797000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:17.797810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 224/460] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:17.798963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:17.798963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:17.799160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:17.801354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:17.818882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 237/461] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:17.825800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:17.861829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:18.036586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137f5bb-2d59-4070-a99e-78a138e588f7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.036841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6807a-6041-403a-9b8c-17fb19c11dda None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.106586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.107589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.108047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.108497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.114178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.114994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.115390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.115795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.116616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:18.117042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:18.119578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:18.135352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:18.147418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:18.149077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:18.151371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:18.153080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 238/462] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:18.153080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:18.156072 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 225/463] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:18.158053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:18.243253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:18.314051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:18.355762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a981f-1d6f-4842-8493-50384b261c5f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.374589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c64aa9-31b9-48a4-ae9d-e59440eb3092 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.426460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.427479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.427849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.428217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.443819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:18.446018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:18.450948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.452006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.452466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.452931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:18.465346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:18.467570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:18.470414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:18.470414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:18.470414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:18.470919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:18.471121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 239/464] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:18.471121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:18.471498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:18.499397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:18.501046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:18.503146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:18.507583 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 226/465] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:18.509623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:18.681610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee100-40c0-4cc7-b1b9-583deba0b3e6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.715972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:18.722195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d43f80-339b-4777-98ba-844e6127bb04 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.736496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:18.753703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.755208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.755933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.756698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.758289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:18.759108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:18.761914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:18.778314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 240/466] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:18.780111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:18.793000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.793685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.793966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.794240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.794900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:18.795265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:18.796740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:18.817687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 227/467] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:18.817687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:18.940089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8a45-25e4-4c5c-9c81-d41769dbde46 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.980653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639273b1-8aac-4255-a29d-0645281054d0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:18.982031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:18.982878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:18.983305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:18.983763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:18.998843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.000857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:19.018442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:19.019471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:19.020319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:19.020319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:19.020319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:19.027498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 228/468] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:19.028777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:19.047988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:19.048802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.050363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.050918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.051557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.052912 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:19.053566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.056266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.080793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 241/469] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:19.082574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:19.155920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:19.169996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36f461-9887-4690-b909-48c26ee11a58 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:19.215637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.216364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.216761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.217850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.229117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.230810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.235502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215a77d-526e-4c1f-80fa-bd4b6992f45b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:19.246290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:19.247305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 28 19:44:19.248186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:19.253075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 229/470] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:19.255949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:19.292180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.293104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.293487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.293770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.294450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:19.294756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.297150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.317483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 242/471] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:19.319413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:19.357340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:19.400509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30e590-697f-4a1e-babc-a019a33b9e5f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:19.455415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.456043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.456317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.456591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.457333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] RBAC: Adding query filter params (role.id=397543bbcaeb4ccfb989c8a046f27b2f, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=237bbe3771c249449b4c2cad20fa5ce4) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:19.457671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.459156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.466442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c8ecef-4dde-48d1-8742-cf6e02d4e555 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:19.467327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 230/472] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:19 2022] GET /identity/v3/role_assignments?user.id=237bbe3771c249449b4c2cad20fa5ce4&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=397543bbcaeb4ccfb989c8a046f27b2f => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:19.468222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:19.479221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:19.511572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.512580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.513048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.513569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.514543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:19.515070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.517061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.543974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 243/473] 10.222.0.52 () {56 vars in 1139 bytes} [Fri Oct 28 19:44:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:19.545871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:19.600885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3c6be-471d-4bbf-b513-20497a557abd None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:19.642524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4fcf1-116f-4dce-a959-b1a4a790c1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.643190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4fcf1-116f-4dce-a959-b1a4a790c1fa None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.643467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4fcf1-116f-4dce-a959-b1a4a790c1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.643735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4fcf1-116f-4dce-a959-b1a4a790c1fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.648350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:19.662579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4fcf1-116f-4dce-a959-b1a4a790c1fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.671513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4fcf1-116f-4dce-a959-b1a4a790c1fa None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-37b4fcf1-116f-4dce-a959-b1a4a790c1fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:19.716292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:19.718963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:44:19.720614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:19.724722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 231/474] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:19.727191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217ee6-048b-4350-93af-177fb1768121 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.727633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217ee6-048b-4350-93af-177fb1768121 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.728070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217ee6-048b-4350-93af-177fb1768121 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.737469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 232/475] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:19.737469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6217ee6-048b-4350-93af-177fb1768121 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:19.771773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58713241-4c0c-4d38-82a0-f8265dc686a2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:19.833135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.833822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.834152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.834443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.893684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:19.901327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6217ee6-048b-4350-93af-177fb1768121 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:19.938591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.940480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.951413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194f12-2f91-47c9-949f-f36ae8c6e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:19.952042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194f12-2f91-47c9-949f-f36ae8c6e52e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.952315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194f12-2f91-47c9-949f-f36ae8c6e52e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.952581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194f12-2f91-47c9-949f-f36ae8c6e52e None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:19.953405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194f12-2f91-47c9-949f-f36ae8c6e52e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:19.953747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194f12-2f91-47c9-949f-f36ae8c6e52e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:19.955411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194f12-2f91-47c9-949f-f36ae8c6e52e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:19.985203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 233/476] 10.222.0.52 () {56 vars in 1137 bytes} [Fri Oct 28 19:44:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:19.985203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224f65-e773-43a9-84ef-909083a8d5ed None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:19.985203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224f65-e773-43a9-84ef-909083a8d5ed None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:19.985203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91224f65-e773-43a9-84ef-909083a8d5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.006061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-91224f65-e773-43a9-84ef-909083a8d5ed None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:20.007681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-91224f65-e773-43a9-84ef-909083a8d5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:20.076372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:20.080295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 244/477] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:20.081164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:20.106655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 234/478] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:20.109332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c398d-fa0b-451d-925d-60eb854ea8a6 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.110186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c398d-fa0b-451d-925d-60eb854ea8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.111582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c398d-fa0b-451d-925d-60eb854ea8a6 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.121438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 235/479] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:20 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:20.123605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c398d-fa0b-451d-925d-60eb854ea8a6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:20.192057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:20.241743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7861c-f11e-42ab-abce-f67cbe59aa78 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:20.296175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:20.297800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.298343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.298871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.356271 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c398d-fa0b-451d-925d-60eb854ea8a6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:20.387338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:20.389772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:20.429748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee952582-71fa-40aa-aacd-5cf2a5aa6477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:20.430978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952582-71fa-40aa-aacd-5cf2a5aa6477 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.431584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952582-71fa-40aa-aacd-5cf2a5aa6477 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.432044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee952582-71fa-40aa-aacd-5cf2a5aa6477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.453743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952582-71fa-40aa-aacd-5cf2a5aa6477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:20.456491 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee952582-71fa-40aa-aacd-5cf2a5aa6477 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:20.469438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ee952582-71fa-40aa-aacd-5cf2a5aa6477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:20.484388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:20.485938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:20.486759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:20.486759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:20.486759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:20.486759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 236/480] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:20.488800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdf75-8e7b-40e1-9803-2a98b4e1f1ad None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.489245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdf75-8e7b-40e1-9803-2a98b4e1f1ad None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.489745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fdf75-8e7b-40e1-9803-2a98b4e1f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.521311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 245/481] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:20.521848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:20.531158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-445fdf75-8e7b-40e1-9803-2a98b4e1f1ad None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:20.533209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-445fdf75-8e7b-40e1-9803-2a98b4e1f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:20.591086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:20.648372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 237/482] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:20.650168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fdf75-8e7b-40e1-9803-2a98b4e1f1ad None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:20.671974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0c4c7-5091-437e-96b9-094da8259a53 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:20.712092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:20.713080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.713600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.714062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.729221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:20.735235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:20.736737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:20.737916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:20.745243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 246/483] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:20.746560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:20.777997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:20.872709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fdf75-8e7b-40e1-9803-2a98b4e1f1ad None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:20.914066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:20.914603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:20.914900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:20.915154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:20.915813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:20.916117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:20.917563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:20.925945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e77345-7220-4334-81c4-da743903b4df None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:20.935907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 238/484] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:20.936939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:20.970553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:20.998053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:20.999469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.000469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.001260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.019586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.021231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:21.041459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:21.042909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:21.044039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:21.044039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:21.044039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:21.049109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 247/485] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:21.050128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.097551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b848ff-3eea-409f-94fc-db59a38c05b2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.153941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.155021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.155931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.156523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.158915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:21.159816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.162750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.172356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:21.180159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 239/486] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:21.181037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.206670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd7062-01bd-4061-9a20-2e3f0cf326e1 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.261403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.262091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.262367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.262637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.271794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.273770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:21.287318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:21.289048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:21.290812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:21.293569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 248/487] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:21.294487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.304789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:21.322830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036b012-2467-4fa8-9785-fbadb2e39818 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.379622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.380951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.381364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.381802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.400373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:21.409053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:21.410819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:21.412950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 240/488] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:21.414908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.452768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb67d9b-b16b-4cb0-8c5b-e087fab45980 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.511870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.513181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.513693 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.514444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.515473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:21.516138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.518827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.533747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:21.545871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 249/489] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:21.546858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.560167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2336bd4-2d28-4986-85b3-edf5189b4510 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.603013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.603910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.604281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.604672 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.622809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.624477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.636659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:21.651614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:21.652607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:21.654010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:21.654010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:21.654010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:21.654010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 241/490] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:21.655195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.712297 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3722455-3259-4875-8848-07a1463a2cd7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.784402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.785035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.785302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.785624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.786308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:21.786614 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.788144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.793521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeff6a7-935a-4dc7-9a1a-b07068a18b8b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:21.802018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 250/491] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:21.807686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.838656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:21.839405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:21.839681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:21.839962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:21.840671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:21.840977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:21.842763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:21.853768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 242/492] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:21.854710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:21.901543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:21.956414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:21.961208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc654f1-897b-4fd5-bcb8-e13c85f153d2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.003512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.004164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.004431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.004743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.012560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.014137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:22.027846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:22.029571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:22.031861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:22.033321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408549a-a8db-4423-8dee-a7bbcd35a977 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.034245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 251/493] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:22.035234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:22.080901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.082442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.082927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.083400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.084535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:22.085065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.087653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.114868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 243/494] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:22.114868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:22.162392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee0145-29b1-4c5b-85cf-992b80a0292f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.183372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:22.205125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.205783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.206160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.206440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.207178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] RBAC: Adding query filter params (role.id=397543bbcaeb4ccfb989c8a046f27b2f, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=7157e60fb6fb4b84866ce59f051a9037) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:22.207601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.209106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.224946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 252/495] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/role_assignments?user.id=7157e60fb6fb4b84866ce59f051a9037&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=397543bbcaeb4ccfb989c8a046f27b2f => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:22.224946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:22.324070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659448-a7ca-4804-ae38-80bb64027ede None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.373312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56695e8-d258-4874-af38-db74943bfac6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.391778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.392930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.393465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.393979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.415150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.418159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.420060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:22.426394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.427546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.427981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.428402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.429286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:22.429800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.431513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.448326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 253/496] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:22.449568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:22.455383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:22.456394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:22.457592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:22.457592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:22.457592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:22.457592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 244/497] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:22.457825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:22.534016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:22.601223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cae42-d874-4b2c-9cf0-637d66344f9d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.606793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530096a-e132-4b01-a885-c2dffc74f604 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.643994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.644520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.644792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.645058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.645817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] RBAC: Adding query filter params (role.id=397543bbcaeb4ccfb989c8a046f27b2f, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=e609d787cb964803b2630895f155a2c5) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:22.646171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.647958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.648061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac03a62-d6cb-464e-aecd-67f0b992861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.648608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03a62-d6cb-464e-aecd-67f0b992861a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.648884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03a62-d6cb-464e-aecd-67f0b992861a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.649154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac03a62-d6cb-464e-aecd-67f0b992861a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.665735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 245/498] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/role_assignments?user.id=e609d787cb964803b2630895f155a2c5&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=397543bbcaeb4ccfb989c8a046f27b2f => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:22.665735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:22.669148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac03a62-d6cb-464e-aecd-67f0b992861a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.670551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac03a62-d6cb-464e-aecd-67f0b992861a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-cac03a62-d6cb-464e-aecd-67f0b992861a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:22.686474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:22.687517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:22.688416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:22.693253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 254/499] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:22.695191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee0211-0d76-4076-a894-2dec7830e919 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.695615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee0211-0d76-4076-a894-2dec7830e919 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.695958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee0211-0d76-4076-a894-2dec7830e919 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.702707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 255/500] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:22.702707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee0211-0d76-4076-a894-2dec7830e919 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:22.730951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:22.819926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da940a9b-a024-4b0e-9f0a-6e8a0c3cd6d8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.863349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee0211-0d76-4076-a894-2dec7830e919 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:22.865756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:22.869583 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f93671-0d1b-432c-9714-04d4eabbdb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.870251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f93671-0d1b-432c-9714-04d4eabbdb4b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.870531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f93671-0d1b-432c-9714-04d4eabbdb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.870831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f93671-0d1b-432c-9714-04d4eabbdb4b None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.871949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f93671-0d1b-432c-9714-04d4eabbdb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:22.872418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f93671-0d1b-432c-9714-04d4eabbdb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.874274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f93671-0d1b-432c-9714-04d4eabbdb4b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.890164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 246/501] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:22.891951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f497e-5ab3-4d7f-bb83-0772c5a43830 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.892237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f497e-5ab3-4d7f-bb83-0772c5a43830 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.892514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f497e-5ab3-4d7f-bb83-0772c5a43830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.920525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:22.921108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:22.921463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:22.921758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:22.922091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b41f497e-5ab3-4d7f-bb83-0772c5a43830 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:22.922518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:22.922816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:22.923278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b41f497e-5ab3-4d7f-bb83-0772c5a43830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:22.924290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:22.957724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 256/502] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:22.960069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:23.016000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 247/503] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:23.016000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f497e-5ab3-4d7f-bb83-0772c5a43830 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:23.061979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:23.218978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540141b6-5fde-4163-8d4b-0c57f4a32afe None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:23.221503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f497e-5ab3-4d7f-bb83-0772c5a43830 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:23.272475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:23.273129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:23.273468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:23.273739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:23.282496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:23.283984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:23.294952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:23.295569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:23.295843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:23.296125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:23.297672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:23.299712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:23.301758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 257/504] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Oct 28 19:44:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:23.305775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:23.343806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:23.460455 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:23.462010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:23.524923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:23.557274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a96fc3-6f2a-4b0f-91f8-7432cbd609fd None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:23.618022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 248/505] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 28 19:44:23.623615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:23.647243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:23.648161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:23.648578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:23.649053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:23.650203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:23.650743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:23.652457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:23.675685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 258/506] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Oct 28 19:44:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:23.677007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:23.819110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:23.820070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3829a-8692-41f6-9b8a-6da15109bb2a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:23.852802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0869b6-8d76-4ef1-a6a8-de6a093b93b1 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:23.881474 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:23.905242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:23.908085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:23.908912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:23.909612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:23.912537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:23.913671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:23.914055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:23.914791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:23.928832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:23.930539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:23.936367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:23.940329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:23.948822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:23.950964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:23.952853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:23.952853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:23.952853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:23.956729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 259/507] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:23.957963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:23.977343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:23.979207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:23.986558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:23.986558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:23.986558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:23.986558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 249/508] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:23.986558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.112085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33314e-72f1-4065-8792-89cfc5d34c69 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:24.165030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58a783-9dff-4e18-b03a-abb0987f93b1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:24.189900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:24.201862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:24.203340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.204439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.204932 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.210155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:24.211281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.211765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.212227 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.213089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:24.213686 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:24.215291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:24.230164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 250/509] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:24.231310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:24.231649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.234334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:24.277326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:24.278369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:24.279259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:24.279259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:24.279259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:24.285517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 260/510] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:24.286943 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.308474 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:24.359377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad63420-1526-4424-8c05-8e19c53bc530 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:24.424093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:24.424649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.425004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.425274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.426082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:24.426387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:24.427832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:24.449209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 251/511] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:24.450975 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.454702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fa0e0-d88f-41c7-bc10-4bed7fa36f5d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:24.498369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:24.499058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.499494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.499768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.509068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:24.510761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:24.524409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:24.526181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 261/512] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:24.527830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.583094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:24.654551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d945af0-6e71-4d4d-a6a0-9401d1dd4759 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:24.679619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:24.685086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d5c11-b58b-4dd7-a79e-60cb90235ebd None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:24.703739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:24.704671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.705253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.705740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.706415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:24.707922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:24.737450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 262/513] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:44:24 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:24.737450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.783816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:24.784513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:24.784980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:24.785256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:24.785970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:24.786277 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:24.788062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:24.828007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 252/514] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:24.831663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:24.973466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:24.984701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da762-f56a-4c6d-8c45-07fe4d9ca323 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:25.073076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:25.073747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.074021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.074289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.075010 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:25.075317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:25.076819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:25.100998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0376b-696f-4091-ac01-b54c8c902f8a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:25.103720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 263/515] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:25.110894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:25.172652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:25.173761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.174229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.174705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.188590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:25.191344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:25.205612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:25.206564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:25.207445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 253/516] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:25.215224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:25.243966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:25.254722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312e09a-d8da-4c4f-82de-bb65ab92ab08 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:25.298052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:25.298958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.299502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.299973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.301028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] RBAC: Adding query filter params (role.id=397543bbcaeb4ccfb989c8a046f27b2f, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=5eb5a6ff4af64a9980bcaa49f3c97bba) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:25.301583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:25.303602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:25.311496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 264/517] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:25 2022] GET /identity/v3/role_assignments?user.id=5eb5a6ff4af64a9980bcaa49f3c97bba&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=397543bbcaeb4ccfb989c8a046f27b2f => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:25.349395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3bf586-9673-4efa-af62-ce960401525c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:25.390790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58992299-fe79-4594-a302-287e49076740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:25.391431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58992299-fe79-4594-a302-287e49076740 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.391703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58992299-fe79-4594-a302-287e49076740 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.391971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58992299-fe79-4594-a302-287e49076740 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.392696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58992299-fe79-4594-a302-287e49076740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:25.392978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58992299-fe79-4594-a302-287e49076740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:25.394514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58992299-fe79-4594-a302-287e49076740 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:25.410919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 254/518] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:25.417707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:25.466519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:25.566478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b70dd-59e1-4818-98b5-506fac826601 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.567055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b70dd-59e1-4818-98b5-506fac826601 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.568330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b70dd-59e1-4818-98b5-506fac826601 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.570694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 255/519] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:25.577477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96da25b-7eba-4745-a16c-f0b0b09509c2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.578385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96da25b-7eba-4745-a16c-f0b0b09509c2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.578852 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96da25b-7eba-4745-a16c-f0b0b09509c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.583851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09555732-b989-467d-94be-4f928e8205e2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:25.602761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e96da25b-7eba-4745-a16c-f0b0b09509c2 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:25.604416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e96da25b-7eba-4745-a16c-f0b0b09509c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:25.630000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cdd8f-9ac5-40f5-a72d-984241f4870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:25.630724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cdd8f-9ac5-40f5-a72d-984241f4870d None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.631001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cdd8f-9ac5-40f5-a72d-984241f4870d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.631277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cdd8f-9ac5-40f5-a72d-984241f4870d None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/8e5bd5f8509b414c8699ec51117745cb/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.633326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cdd8f-9ac5-40f5-a72d-984241f4870d None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=8e5bd5f8509b414c8699ec51117745cb, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:25.634867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cdd8f-9ac5-40f5-a72d-984241f4870d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:25.651420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 265/520] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:25 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/8e5bd5f8509b414c8699ec51117745cb/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:25.652856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba61d3d-72f6-4c3c-a58a-3d0af3d3e9b7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.653146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba61d3d-72f6-4c3c-a58a-3d0af3d3e9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.653458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba61d3d-72f6-4c3c-a58a-3d0af3d3e9b7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.655187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 266/521] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:25.662394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8fe2-2eb1-4f09-bc93-4bc324966b87 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:25.662394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8fe2-2eb1-4f09-bc93-4bc324966b87 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:25.662394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8fe2-2eb1-4f09-bc93-4bc324966b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:25.686603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7c9f8fe2-2eb1-4f09-bc93-4bc324966b87 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:25.688041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7c9f8fe2-2eb1-4f09-bc93-4bc324966b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:25.705895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 256/522] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:25.788333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 267/523] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 28 19:44:26.062989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96da25b-7eba-4745-a16c-f0b0b09509c2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:26.076162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:26.181469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8fe2-2eb1-4f09-bc93-4bc324966b87 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:26.194153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96da25b-7eba-4745-a16c-f0b0b09509c2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:26.213352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:26.241201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:26.241897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:26.242177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:26.242448 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:26.245057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:26.246518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:26.273016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:26.274172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:26.275027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 257/524] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Oct 28 19:44:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:26.282893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:26.408690 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8fe2-2eb1-4f09-bc93-4bc324966b87 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:26.441816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:26.485213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:26.487091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:26.487502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:26.488809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] PATH_INFO: `/v3/services/network` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:26.489628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:26.491394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:26.498846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca12e9f-b6d7-4413-a5f3-baf63a8f3047 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:26.518972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:26.520235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:26.521347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:26.525478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 268/525] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:26 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:26.534570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:26.564514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:26.565176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:26.565545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:26.565820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:26.566469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:26.566771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:26.568337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:26.580560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 258/526] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Oct 28 19:44:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:26.587320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:26.686524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:26.746866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1018a5a-9cfc-4ebb-92c0-bb73d24bed90 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:26.798619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262a3d4-24cc-4649-a295-a4976f7f45e0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:26.826858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:26.827491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:26.827768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:26.828076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:26.828725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] RBAC: Adding query filter params (name=network) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:26.829029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:26.831875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:26.840858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 269/527] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:26.847440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:26.863573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ce660-3663-40c9-b4f3-3d3e11eaf963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:26.864174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce660-3663-40c9-b4f3-3d3e11eaf963 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:26.864442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce660-3663-40c9-b4f3-3d3e11eaf963 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:26.869662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce660-3663-40c9-b4f3-3d3e11eaf963 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:26.869662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce660-3663-40c9-b4f3-3d3e11eaf963 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:26.869662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce660-3663-40c9-b4f3-3d3e11eaf963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:26.869662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce660-3663-40c9-b4f3-3d3e11eaf963 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:26.874260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 259/528] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Oct 28 19:44:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:27.078545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405da0c9-b47e-4cf6-8558-86c6361b4b82 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:27.146035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9717c-2b13-4b20-a7ee-4c5bd1d18720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:27.147798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9717c-2b13-4b20-a7ee-4c5bd1d18720 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:27.148528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9717c-2b13-4b20-a7ee-4c5bd1d18720 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:27.149283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9717c-2b13-4b20-a7ee-4c5bd1d18720 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:27.150761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9717c-2b13-4b20-a7ee-4c5bd1d18720 None admin] RBAC: Adding query filter params (type=network) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:27.151512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9717c-2b13-4b20-a7ee-4c5bd1d18720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:27.154312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9717c-2b13-4b20-a7ee-4c5bd1d18720 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:27.166407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 270/529] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:28.304167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d10a8a-ab3f-41be-92ce-c559b825ec9d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:28.304769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d10a8a-ab3f-41be-92ce-c559b825ec9d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:28.304769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d10a8a-ab3f-41be-92ce-c559b825ec9d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:28.306643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 260/530] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:28.314351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f95e-d34e-48ae-809a-543aad06562e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:28.314935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f95e-d34e-48ae-809a-543aad06562e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:28.315018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f95e-d34e-48ae-809a-543aad06562e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:28.325674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:28.343170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9659f95e-d34e-48ae-809a-543aad06562e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:28.345125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9659f95e-d34e-48ae-809a-543aad06562e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:28.450654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 271/531] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:28.690500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523e1fe-8f8a-449e-824d-120c853f9779 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:28.691154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523e1fe-8f8a-449e-824d-120c853f9779 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:28.691690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523e1fe-8f8a-449e-824d-120c853f9779 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:28.693637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 261/532] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:28.696685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54fd0-0695-4fce-92ab-608404426957 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:28.697282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54fd0-0695-4fce-92ab-608404426957 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:28.699172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635b36-bfaf-4fdd-be32-2821b1fb7f40 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:28.699697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635b36-bfaf-4fdd-be32-2821b1fb7f40 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:28.700173 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30635b36-bfaf-4fdd-be32-2821b1fb7f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:28.703734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab54fd0-0695-4fce-92ab-608404426957 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:28.709996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:28.710806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 272/533] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:28.718937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fd1e0-42a9-4aa0-93a0-b3c2ca69afda None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:28.719614 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fd1e0-42a9-4aa0-93a0-b3c2ca69afda None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:28.720089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fd1e0-42a9-4aa0-93a0-b3c2ca69afda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:28.744086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-30635b36-bfaf-4fdd-be32-2821b1fb7f40 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:28.746116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-30635b36-bfaf-4fdd-be32-2821b1fb7f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:28.777392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-280fd1e0-42a9-4aa0-93a0-b3c2ca69afda None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:28.779449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-280fd1e0-42a9-4aa0-93a0-b3c2ca69afda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:28.938969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 273/534] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:28.989214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 262/535] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:29.126221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fd1e0-42a9-4aa0-93a0-b3c2ca69afda None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:29.265777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:29.342158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fd1e0-42a9-4aa0-93a0-b3c2ca69afda None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:29.409270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:29.410417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:29.410895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:29.411376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:29.431540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:29.440958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:29.441997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:29.442816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:29.444029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 274/536] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:29.452114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30635b36-bfaf-4fdd-be32-2821b1fb7f40 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:29.489290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:29.654154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30635b36-bfaf-4fdd-be32-2821b1fb7f40 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:29.695123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0c9f1-de8e-436a-87fe-033f88f944ac None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:29.714700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:29.731558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:29.732841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:29.732983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:29.733833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:29.734804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:29.735926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:29.736597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:29.739500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:29.751028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:29.752008 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:29.752435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:29.752849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:29.758136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 263/537] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:29.759843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:29.777017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:29.788166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:29.789215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:29.790114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:29.791715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 275/538] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:29.793742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:29.930944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98c913-965d-49bb-9cfb-29f0a870daa2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:29.970722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:29.971376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:29.971770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:29.972045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:29.984537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:29.991669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:29.993234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 264/539] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:29.996192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.027655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56481a-3179-4d58-8a71-a62de4d95942 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.060863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:30.100867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.102408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.103066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.103720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.120444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44f872-0c29-4ab3-8e23-16e5b963a979 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.127340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.130777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:30.161898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.162518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.162796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.163066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.163736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:30.164036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.165449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:30.169928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:30.171925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:30.173713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:30.173713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:30.173713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:30.181899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 265/540] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:30.182640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 276/541] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:30.185486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.187860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.255798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:30.306874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de171357-6b9d-47d9-8151-107d60b0d30c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.326079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:30.349714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.350354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.350707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.350983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.351692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:30.351999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.353459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:30.368243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 266/542] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:30.368243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.390917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328eb7f-a0c9-42c4-bf00-c321cb711eaa None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.447277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd916ab-53aa-43c8-9632-f81c3f6b01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.448107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd916ab-53aa-43c8-9632-f81c3f6b01d6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.448472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd916ab-53aa-43c8-9632-f81c3f6b01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.448813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd916ab-53aa-43c8-9632-f81c3f6b01d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.461873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd916ab-53aa-43c8-9632-f81c3f6b01d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.463595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd916ab-53aa-43c8-9632-f81c3f6b01d6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4bd916ab-53aa-43c8-9632-f81c3f6b01d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:30.481037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:30.483329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:30.486144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:30.486144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:30.486144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:30.489627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 277/543] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:30.491791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c060c25-3035-4be1-b0f0-8ba836a4e83e None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.492101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c060c25-3035-4be1-b0f0-8ba836a4e83e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.492464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c060c25-3035-4be1-b0f0-8ba836a4e83e None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.494158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 278/544] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:30.495444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c060c25-3035-4be1-b0f0-8ba836a4e83e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.523252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f926ca-baa3-4236-b7f7-1f43779026fe None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.576170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbdac7-e95b-49fd-851a-2e437fad8326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.577114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbdac7-e95b-49fd-851a-2e437fad8326 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.577640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbdac7-e95b-49fd-851a-2e437fad8326 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.578058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbdac7-e95b-49fd-851a-2e437fad8326 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.579146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbdac7-e95b-49fd-851a-2e437fad8326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:30.579623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbdac7-e95b-49fd-851a-2e437fad8326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.581974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbdac7-e95b-49fd-851a-2e437fad8326 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:30.598999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 267/545] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:30.600826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e76b6c-c0d6-4aef-86b4-739c8a378990 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.601267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e76b6c-c0d6-4aef-86b4-739c8a378990 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.602919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e76b6c-c0d6-4aef-86b4-739c8a378990 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.607565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 268/546] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:30.607565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e76b6c-c0d6-4aef-86b4-739c8a378990 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.628679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:30.648602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c060c25-3035-4be1-b0f0-8ba836a4e83e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.666128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:30.697697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a96b7-aa8f-464a-898c-6982dc2e883c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.699079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a96b7-aa8f-464a-898c-6982dc2e883c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.699530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a96b7-aa8f-464a-898c-6982dc2e883c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.699946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a96b7-aa8f-464a-898c-6982dc2e883c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.719108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a96b7-aa8f-464a-898c-6982dc2e883c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.722503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a96b7-aa8f-464a-898c-6982dc2e883c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:30.745017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e76b6c-c0d6-4aef-86b4-739c8a378990 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-cd5a96b7-aa8f-464a-898c-6982dc2e883c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:30.751087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:30.752729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:30.754431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:30.754431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:30.754431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:30.754431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 279/547] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:30.755498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f09f2-6e20-428b-8302-76fde8756fdf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.755930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f09f2-6e20-428b-8302-76fde8756fdf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.756389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f09f2-6e20-428b-8302-76fde8756fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.784077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bb3f09f2-6e20-428b-8302-76fde8756fdf None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:30.786207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bb3f09f2-6e20-428b-8302-76fde8756fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:30.789188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.789990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.790135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.790399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.791086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:30.792347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.792832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:30.808237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 269/548] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:30.808814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:30.888088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 280/549] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:30.889847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044e215-199d-479b-be03-2d40f314da19 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.890265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044e215-199d-479b-be03-2d40f314da19 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.890623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044e215-199d-479b-be03-2d40f314da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.918728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7044e215-199d-479b-be03-2d40f314da19 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:30.919992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7044e215-199d-479b-be03-2d40f314da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:30.930764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:30.935665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d97547-f2ee-4fcc-b1e1-95f5f4ba3888 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:30.981078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:30.981824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:30.982108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:30.982393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:30.991258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:30.992770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:31.005685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:31.007555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 270/550] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:44:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:31.009916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.039390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:31.045517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 281/551] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 28 19:44:31.046133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044e215-199d-479b-be03-2d40f314da19 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.182334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1edf2-5f7f-4cec-a422-9e67cdedda3b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.223625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.224428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.224804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.225172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.226180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:31.226374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.228191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.239170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044e215-199d-479b-be03-2d40f314da19 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.250087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 271/552] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:31.252693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.282928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.283803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.284182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.284643 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.294014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.295808 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.300453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:31.313006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:31.315092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:31.317252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 282/553] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Oct 28 19:44:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:31.319159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.408493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:31.431389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bfe2-3e72-45b7-a9cc-d7e63ee0688f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.471829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b351e-714d-4312-8884-085f47ce4f6f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.473140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.473808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.474087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.474358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.475113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:31.475413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.476911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.497369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 272/554] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Oct 28 19:44:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:31.498202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.528860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.529855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.530288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.530827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.544456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.547111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:31.566446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:31.567578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 283/555] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:31.569606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.626427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:31.663529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219227c-e5a3-4a18-a4ec-42e71cec0f54 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.708592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41dcb1-4e6c-48d8-9f9b-5aca16b0fa35 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.719983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.721732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.722680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.723146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.724457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:31.724967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.727680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.735040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:31.752926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.753501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 273/556] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Oct 28 19:44:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:31.753688 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.753827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.754163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.754329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.754736 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.756274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.779607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 284/557] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:44:31 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:31.780902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:31.914195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0bb53-7736-450d-8b5b-0cd54f2f673f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.973351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190038b5-2769-453d-a72a-017c58db02b2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:31.977878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:31.978755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:31.979216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:31.979676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:31.980814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:31.983269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:31.989703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:32.008488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 274/558] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:44:31 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:32.009907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:32.053168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:32.054994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:32.055787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:32.056715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:32.077684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:32.081161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:32.115587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:32.117141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:32.119303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:32.119303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:32.119303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:32.120950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 285/559] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:32.123151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:32.178053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:32.235277 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473241eb-299c-4e3d-a903-c52d57d3485a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:32.292660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:32.293363 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:32.293725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:32.294132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:32.294917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:32.295222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:32.297044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:32.313124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c97a18-a077-4503-bfe0-cc52c35a11e8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:32.328854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 275/560] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Oct 28 19:44:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:32.329479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:32.362446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:32.363090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:32.363479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:32.363753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:32.422500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:32.453576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:32.455099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:32.493061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:32.513492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c030a-2fd6-45ab-9582-4f3ece9cf279 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:32.557489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:32.558571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:32.559111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:32.559533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:32.560374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:32.560915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:32.562754 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:32.577775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 276/561] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:32.578937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:32.645545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 286/562] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:44:32.647578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:32.719917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca507fd-f94c-4878-94cf-e92291e79113 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:32.739549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:32.768579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:32.769663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:32.770143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:32.770607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:32.786880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:32.788743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:32.808241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:32.809284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:32.810196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:32.810196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:32.810196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:32.813145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 277/563] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:32.814391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:32.862578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ca15f-a540-48dc-b07e-50d8de0199b7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:32.914103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:32.936403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:32.937827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:32.938437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:32.939036 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:32.952388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:32.956542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:32.959945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29a361-6e19-4089-a88b-a4f59d8385f8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:32.982890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:32.983893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:32.984760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:32.990160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 287/564] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:32.996299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:33.006356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:33.007328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:33.007807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:33.008252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:33.028392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:33.032232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:33.066430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:33.067415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:33.068306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:33.068306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:33.068306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:33.069252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 278/565] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:33.071437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:33.113492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:33.156342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b6306-4bb8-408b-8d25-90654f698c02 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:33.200367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:33.201407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:33.201907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:33.202374 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:33.203328 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:33.203835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:33.205695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:33.221076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 288/566] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:33.222469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:33.301399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749073c-5a1d-4991-964c-690a335856fc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:33.301819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:33.358984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:33.360418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:33.361096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:33.362166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:33.365449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:33.366302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:33.369230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:33.402928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 279/567] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:33.402928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:33.436537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5b9a8-c254-4e33-aa3f-0565708d705f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:33.507474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:33.508581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:33.509017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:33.509555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:33.510759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:33.511309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:33.514151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:33.545002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 289/568] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:33.545002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:33.589165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:33.643805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9878b-9834-4e36-9b4d-c7b0cdcde053 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:33.713316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:33.714453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:33.714944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:33.715401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:33.726590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb932052-1c38-44e2-9efc-3c3c7dd7ecdb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:33.730483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:33.732398 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:33.734438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:33.754010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:33.755868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:33.757599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:33.761501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 280/569] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:33.763288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:33.801764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:33.803333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:33.803996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:33.804589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/9b5124cfd2724ed1a5fba427dbe3031e/roles/397543bbcaeb4ccfb989c8a046f27b2f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:33.831647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=9b5124cfd2724ed1a5fba427dbe3031e, role_id=397543bbcaeb4ccfb989c8a046f27b2f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:33.834513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:33.868255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 290/570] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:33 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/9b5124cfd2724ed1a5fba427dbe3031e/roles/397543bbcaeb4ccfb989c8a046f27b2f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:33.870529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:34.030095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410d23a-8e4e-47ef-9b7a-5a955ce93c13 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:34.086188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a886db-2991-4834-bd84-30b0443129f9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:34.113326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:34.114494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.115207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.117408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.124347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:34.134814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:34.140029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:34.163774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:34.164718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:34.166090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:34.170004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 281/571] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:34.181565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:34.193592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:34.194689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.195187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.195680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.199116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:34.199583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:34.201958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:34.237978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 291/572] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:34.253325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:34.292776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:34.472795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785178-bee5-4716-bf1b-e667a7a30c96 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:34.561533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:34.561533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.561533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.561533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.562262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:34.562262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:34.562510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:34.589418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 282/573] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:34.604342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:34.610818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75503699-361f-411c-a3ef-0c217621ba5b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:34.675037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd302a37-3933-4c83-bbb6-021056a04ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:34.675961 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd302a37-3933-4c83-bbb6-021056a04ed7 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.676385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd302a37-3933-4c83-bbb6-021056a04ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.676665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd302a37-3933-4c83-bbb6-021056a04ed7 None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/5eb5a6ff4af64a9980bcaa49f3c97bba/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.679322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd302a37-3933-4c83-bbb6-021056a04ed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=5eb5a6ff4af64a9980bcaa49f3c97bba, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:34.681572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd302a37-3933-4c83-bbb6-021056a04ed7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:34.699869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 292/574] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:34 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/5eb5a6ff4af64a9980bcaa49f3c97bba/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:34.702111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5ef22-fc3c-4f30-a3b2-9f439fafad42 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.702547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5ef22-fc3c-4f30-a3b2-9f439fafad42 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.702726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5ef22-fc3c-4f30-a3b2-9f439fafad42 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.710144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 293/575] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:34.711955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12ab3-933e-404f-968d-98a0fec43f32 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.712276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12ab3-933e-404f-968d-98a0fec43f32 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.712514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de12ab3-933e-404f-968d-98a0fec43f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.767433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:34.779117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0de12ab3-933e-404f-968d-98a0fec43f32 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:34.781689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0de12ab3-933e-404f-968d-98a0fec43f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:34.872717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1699ab-eb74-4fbd-bb3f-5febc467f5dc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:34.900137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 294/576] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:34.900137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eeb75-96bd-46d1-acc8-493e88813a81 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.900137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eeb75-96bd-46d1-acc8-493e88813a81 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.900137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3eeb75-96bd-46d1-acc8-493e88813a81 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.901852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 295/577] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:34.907906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bea9e-5f00-493b-bce2-fd2508cdb16b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.908159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bea9e-5f00-493b-bce2-fd2508cdb16b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.913453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bea9e-5f00-493b-bce2-fd2508cdb16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.921826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:34.960818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-878bea9e-5f00-493b-bce2-fd2508cdb16b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:34.962980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-878bea9e-5f00-493b-bce2-fd2508cdb16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:34.976043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:34.977052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:34.977589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:34.978090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:34.979466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=8e5bd5f8509b414c8699ec51117745cb) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:34.979991 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:34.982786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:35.002059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 283/578] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:34 2022] GET /identity/v3/role_assignments?user.id=8e5bd5f8509b414c8699ec51117745cb&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:35.078012 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 296/579] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:35.326329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:35.473330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bea9e-5f00-493b-bce2-fd2508cdb16b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:35.507680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5bad4-843e-410f-9a03-60fc7aad8e3c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:35.545754 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:35.567556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:35.568201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:35.568521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:35.568801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:35.569453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:35.570875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:35.581050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:35.582108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:35.583117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:35.587260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 284/580] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:35 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:35.588622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:35.678540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bea9e-5f00-493b-bce2-fd2508cdb16b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:35.717656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b769b-51c6-4aa2-a05e-37fa0a6615f2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:35.761999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:35.762723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:35.763003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:35.763563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:35.764242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] RBAC: Adding query filter params (name=network) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:35.764546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:35.766108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:35.777094 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 285/581] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:35.778835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:35.790621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:35.791734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:35.792224 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:35.792711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:35.793832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:35.796480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:35.807993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:35.830880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:35.833295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:35.835338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:35.847988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:35.849446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 297/582] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Oct 28 19:44:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:35.864807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:35.914867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0021a-83c4-403c-ba44-8ee896dd5955 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:35.961491 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:35.962117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:35.962397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:35.962668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:35.963309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:35.963611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:35.965261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:35.976511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 286/583] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:35.977969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:36.097783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e84c6f-ac03-4b17-8292-dfcd701a817f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:36.158481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:36.160917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:36.161468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:36.162965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:36.163645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:36.163954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:36.165410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:36.177453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 298/584] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Oct 28 19:44:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:36.186488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:36.201681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d2ab2-4a04-4175-8c41-3cb9834e30f8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:36.236963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:36.273792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:36.274423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:36.274705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:36.274973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:36.275691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] RBAC: Adding query filter params (interface=public, service_id=c132740a5e5f457f8159804ecbbf91da, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:36.275999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:36.277419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:36.306817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 287/585] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:44:35 2022] GET /identity/v3/endpoints?service_id=c132740a5e5f457f8159804ecbbf91da&interface=public®ion_id=RegionOne => generated 194 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:36.308826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:36.358034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:36.451786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb32414-cbde-43ad-abf9-2963e1d896d3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:36.493017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de339a9-6cd6-4f34-9b53-9c8139bfbb3c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:36.531386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:36.532021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:36.532299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:36.532572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:36.533237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:36.533573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:36.535023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:36.537982 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:36.538605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:36.538887 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:36.539149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:36.539765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:36.541203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:36.547850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 288/586] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:44:36 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:36.548073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 299/587] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Oct 28 19:44:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:36.556954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:36.640518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:36.720177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dde98-7d90-4fbd-bce1-9b67f3e801b7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:36.761273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e490225-2c80-4857-8ce3-d6b77858758c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:36.761936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490225-2c80-4857-8ce3-d6b77858758c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:36.762215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490225-2c80-4857-8ce3-d6b77858758c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:36.762488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e490225-2c80-4857-8ce3-d6b77858758c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:36.763205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e490225-2c80-4857-8ce3-d6b77858758c None admin] RBAC: Adding query filter params (interface=public, service_id=8dc9295e43cb48a39c38794f270a4904, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:36.763516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e490225-2c80-4857-8ce3-d6b77858758c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:36.764996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e490225-2c80-4857-8ce3-d6b77858758c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:36.772151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 289/588] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:44:36 2022] GET /identity/v3/endpoints?service_id=8dc9295e43cb48a39c38794f270a4904&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:36.780974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:36.913311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a5b1a-9099-43d7-a85a-c120b05b5d2b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:36.961735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:36.973334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76ffd5-d9e1-4ca6-84ec-24579b113e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:36.974404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76ffd5-d9e1-4ca6-84ec-24579b113e34 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:36.974896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76ffd5-d9e1-4ca6-84ec-24579b113e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:36.975386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76ffd5-d9e1-4ca6-84ec-24579b113e34 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:36.976233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76ffd5-d9e1-4ca6-84ec-24579b113e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:36.977915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76ffd5-d9e1-4ca6-84ec-24579b113e34 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:36.988654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 300/589] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:44:36 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:37.205372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31445523-0ecc-40e4-8867-ff6bee68aec4 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:37.206567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31445523-0ecc-40e4-8867-ff6bee68aec4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:37.207056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31445523-0ecc-40e4-8867-ff6bee68aec4 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:37.209136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 290/590] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:37.216258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bbce-f2f0-4556-a232-fb598b6f58ff None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:37.216934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bbce-f2f0-4556-a232-fb598b6f58ff None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:37.217439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26bbce-f2f0-4556-a232-fb598b6f58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:37.238345 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ec26bbce-f2f0-4556-a232-fb598b6f58ff None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:37.240027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ec26bbce-f2f0-4556-a232-fb598b6f58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:37.340757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 301/591] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:37.632667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31445523-0ecc-40e4-8867-ff6bee68aec4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:37.795053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31445523-0ecc-40e4-8867-ff6bee68aec4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:37.800644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:37.856636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:37.857301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:37.857611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:37.857869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:37.883749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:37.888822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:37.890909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:37.892643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 291/592] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:44:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:37.899541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26bbce-f2f0-4556-a232-fb598b6f58ff None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:38.162133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26bbce-f2f0-4556-a232-fb598b6f58ff None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:38.191269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:38.213705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5fd18-09d2-43ea-b40c-c89738d80f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:38.214400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fd18-09d2-43ea-b40c-c89738d80f58 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:38.214682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fd18-09d2-43ea-b40c-c89738d80f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:38.214952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5fd18-09d2-43ea-b40c-c89738d80f58 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:38.215633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fd18-09d2-43ea-b40c-c89738d80f58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:38.215934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fd18-09d2-43ea-b40c-c89738d80f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:38.217512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5fd18-09d2-43ea-b40c-c89738d80f58 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:38.232347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 302/593] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:44:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:38.240642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:38.244299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26547b05-ff8a-44be-affa-8a0e27269256 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:38.244648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26547b05-ff8a-44be-affa-8a0e27269256 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:38.244928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26547b05-ff8a-44be-affa-8a0e27269256 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:38.246960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 303/594] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:44:38.267578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4da3d-0b24-4625-91e6-b21781d2ce7b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:38.267879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4da3d-0b24-4625-91e6-b21781d2ce7b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:38.268216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4da3d-0b24-4625-91e6-b21781d2ce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:38.305532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0cc4da3d-0b24-4625-91e6-b21781d2ce7b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:38.308764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0cc4da3d-0b24-4625-91e6-b21781d2ce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:38.397055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 304/595] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:44:38.402519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f06fd-e81b-4765-8859-cf99431ec82c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:38.404284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f06fd-e81b-4765-8859-cf99431ec82c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:38.405218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f06fd-e81b-4765-8859-cf99431ec82c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:38.409637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 305/596] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:38.423460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d2a8-e03d-4585-a788-0336e51e70a9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:38.424289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d2a8-e03d-4585-a788-0336e51e70a9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:38.427839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284f93a-5b58-4cb6-8c94-d039d9bb0260 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:38.428798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08d2a8-e03d-4585-a788-0336e51e70a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:38.461250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8d08d2a8-e03d-4585-a788-0336e51e70a9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:38.462633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8d08d2a8-e03d-4585-a788-0336e51e70a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:38.519082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:38.520627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:38.521694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:38.522468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:38.544431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:38.547822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:38.578569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:38.580465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:38.582253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:38.582253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:38.582253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:38.586208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 292/597] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:38.592499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:38.615839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 306/598] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:44:38.653774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:38.824581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9177e-c471-4f75-90c5-25e3349703b5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:38.830070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08d2a8-e03d-4585-a788-0336e51e70a9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:38.893939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:38.905903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:38.906866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:38.907442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:38.907889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:38.909017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:38.909738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:38.912574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:38.946726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 293/599] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:38.954634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.021697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08d2a8-e03d-4585-a788-0336e51e70a9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.094499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.095194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.095470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.095771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.109191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:39.114394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:39.116426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:44:39.118194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:39.119480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:39.119636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 307/600] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:39.119636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.183222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fb893-7dc1-485f-917e-6d77520854c5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.251056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e581020-eb35-48fd-95db-c8b80672c96e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.253738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:39.277715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.278783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.279279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.279775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.295629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:39.299286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:39.302784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.303785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.304126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.304465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.305141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:39.306677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:39.316930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:39.320338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:39.323755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:39.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:39.338365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:39.340498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 294/602] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:44:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:39.341933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 308/602] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Oct 28 19:44:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:39.342101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.342255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.460829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9485a5-7ef5-48f1-9823-90a8d98db857 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.502680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.503482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.504106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.504450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.505130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:39.505484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:39.506979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:39.517691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 309/603] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:39.518894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.539056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29807cb4-1a76-4c25-8cb0-170644901fd8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.556806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:39.584542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.585167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.585454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.586263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.586948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:39.587527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:39.588937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:39.591570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:39.604997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 295/604] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:39.606135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.649186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38543f8a-7324-4e7c-b7e6-83c977957ae9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.694642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51396541-fafd-43df-a32e-229522a7625d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.695618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396541-fafd-43df-a32e-229522a7625d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.696196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396541-fafd-43df-a32e-229522a7625d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.696935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51396541-fafd-43df-a32e-229522a7625d None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.698290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51396541-fafd-43df-a32e-229522a7625d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:39.698849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51396541-fafd-43df-a32e-229522a7625d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:39.700706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51396541-fafd-43df-a32e-229522a7625d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:39.727791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 310/605] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Oct 28 19:44:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:39.729324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51396541-fafd-43df-a32e-229522a7625d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.734565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e871b89-a5b9-4794-9a54-bce041e4937a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.779842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.780573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.780858 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.781131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.781879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:39.782198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:39.783744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:39.790075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 296/606] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:39.790979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:39.857633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:39.877222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:39.879970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51396541-fafd-43df-a32e-229522a7625d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.930685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03bb76-cb44-4a2f-90d4-935a5df621a3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:39.960038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772e84c-2b21-4898-a552-53838523c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.961075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772e84c-2b21-4898-a552-53838523c03f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.961506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772e84c-2b21-4898-a552-53838523c03f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.961921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772e84c-2b21-4898-a552-53838523c03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.973788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b1a9-63de-4ecd-b241-b51b01954f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:39.974432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b1a9-63de-4ecd-b241-b51b01954f91 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:39.974715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b1a9-63de-4ecd-b241-b51b01954f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:39.975642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b1a9-63de-4ecd-b241-b51b01954f91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:39.982706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772e84c-2b21-4898-a552-53838523c03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:39.985300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772e84c-2b21-4898-a552-53838523c03f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4772e84c-2b21-4898-a552-53838523c03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:40.014645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:40.015770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:40.016645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:40.016645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:40.016645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:40.016645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 311/607] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:40.019332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4f772-cf18-4a07-84fb-67bf7269b28c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.024892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4f772-cf18-4a07-84fb-67bf7269b28c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.024892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4f772-cf18-4a07-84fb-67bf7269b28c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.029863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 312/608] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:40.032534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4f772-cf18-4a07-84fb-67bf7269b28c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:40.119482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b1a9-63de-4ecd-b241-b51b01954f91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:40.122670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b1a9-63de-4ecd-b241-b51b01954f91 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:40.211986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4f772-cf18-4a07-84fb-67bf7269b28c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:40.217809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:40.273449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 297/609] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:44:40.274728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61abb8-0db3-44ca-ac5e-0f5d44770b1d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.275019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61abb8-0db3-44ca-ac5e-0f5d44770b1d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.275318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61abb8-0db3-44ca-ac5e-0f5d44770b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.277755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4284e-c254-4fd0-9756-4f49c9160e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:40.278738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4284e-c254-4fd0-9756-4f49c9160e33 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.279195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4284e-c254-4fd0-9756-4f49c9160e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.279665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4284e-c254-4fd0-9756-4f49c9160e33 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.280839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4284e-c254-4fd0-9756-4f49c9160e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:40.281368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4284e-c254-4fd0-9756-4f49c9160e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:40.283935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4284e-c254-4fd0-9756-4f49c9160e33 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:40.295389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ed61abb8-0db3-44ca-ac5e-0f5d44770b1d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:40.297176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ed61abb8-0db3-44ca-ac5e-0f5d44770b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:40.301186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:40.307166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 313/610] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:40.309503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e340a8-b15f-47fa-93a8-ece549582bdd None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.310019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e340a8-b15f-47fa-93a8-ece549582bdd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.310423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e340a8-b15f-47fa-93a8-ece549582bdd None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.317285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 314/611] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:40.317285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e340a8-b15f-47fa-93a8-ece549582bdd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:40.425424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 298/612] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:40.425424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61abb8-0db3-44ca-ac5e-0f5d44770b1d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:40.515803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e340a8-b15f-47fa-93a8-ece549582bdd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:40.568827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c980c61-2679-4774-aaed-67dc4e41d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:40.569540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980c61-2679-4774-aaed-67dc4e41d39d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.569873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980c61-2679-4774-aaed-67dc4e41d39d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.570214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c980c61-2679-4774-aaed-67dc4e41d39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.586549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980c61-2679-4774-aaed-67dc4e41d39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:40.588128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c980c61-2679-4774-aaed-67dc4e41d39d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:40.612336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-0c980c61-2679-4774-aaed-67dc4e41d39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:40.612773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:40.613905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:40.614790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:40.614790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:40.614790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:40.617560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 315/613] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:40.620181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15b0bf-b421-4b88-b47b-e55eccb013a1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.620660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15b0bf-b421-4b88-b47b-e55eccb013a1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.621079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15b0bf-b421-4b88-b47b-e55eccb013a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.634484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61abb8-0db3-44ca-ac5e-0f5d44770b1d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:40.660840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8d15b0bf-b421-4b88-b47b-e55eccb013a1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:40.664448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8d15b0bf-b421-4b88-b47b-e55eccb013a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:40.684283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:40.685304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.685855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.686366 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.695616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:40.697580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:40.710749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:40.712559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 28 19:44:40.714418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:40.716837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 299/614] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:44:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:40.717901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:40.789962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:40.835246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 316/615] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:40.838460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15b0bf-b421-4b88-b47b-e55eccb013a1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:40.854841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd641d5-ec4f-4cf0-ad81-1b7a8b70c4dc None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:40.912681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:40.915911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:40.918110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:40.918855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:40.920775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:40.924894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:40.927702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:40.960729 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 300/616] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:40.961543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:40.985517 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:41.082200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15b0bf-b421-4b88-b47b-e55eccb013a1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:41.092627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aabe8b-384a-4639-be8d-89dd3224fbda None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:41.133777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:41.134516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:41.134788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:41.135054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] PATH_INFO: `/v3/services/network` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:41.135645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:41.137507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:41.145822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:41.147664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:41.148378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:41.150204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:41.151827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 301/617] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:40 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:41.154901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:41.155610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:41.155821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:41.157026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:41.157752 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:41.160377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:41.191152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 317/618] 10.222.0.52 () {56 vars in 1135 bytes} [Fri Oct 28 19:44:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:41.192914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:41.261183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:41.267525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:41.295086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0481c-65d3-4a6b-8fc5-f52c7018790c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:41.336917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:41.337909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:41.337909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:41.338218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:41.347447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:41.348835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:41.363208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:41.365140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:41.366903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:41.369328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 302/619] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:41.370715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:41.383094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c3cfe-5a9f-4cbc-b91b-ab2a900286c1 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:41.462148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:41.463198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:41.463675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:41.464157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:41.465109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] RBAC: Adding query filter params (name=network) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:41.465659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:41.467390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:41.472974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 318/620] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:41.473864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:41.540362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3441b69-73e5-4828-b93b-0ae44c4cd7bf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:41.591303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:41.592114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:41.592592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:41.592997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:41.598725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:41.631741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02dc1e6-d07e-4d3c-88cc-0d3a65b724cf None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:41.636496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:41.691869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:41.693838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:41.698412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:41.699424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:41.699797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:41.700185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:41.701276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:41.701825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:41.704718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:41.743253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 319/621] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:41.744972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:41.887302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 303/622] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:44:41.887302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:41.903302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c389cf4-11a3-4afb-961e-1eb9eec80049 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:41.930495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:41.971332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:41.972390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:41.972872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:41.973345 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:41.974478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:41.977111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:41.997754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:41.999657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:42.001213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 320/623] 10.222.0.52 () {56 vars in 1129 bytes} [Fri Oct 28 19:44:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:42.003423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:42.026503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444ea2b-167e-49bf-a9f0-7113880709ee None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:42.056083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:42.079006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:42.080741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.081169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.081657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.082741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] RBAC: Adding query filter params (type=network) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:42.083221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:42.086264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:42.095493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 304/624] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:42.096815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:42.191467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39a103-dc79-433b-a194-d09cb74f2895 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:42.235035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:42.235823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.236266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.236645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.237566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] RBAC: Adding query filter params (role.id=397543bbcaeb4ccfb989c8a046f27b2f, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=9b5124cfd2724ed1a5fba427dbe3031e) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:42.238004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:42.239631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:42.257446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 321/625] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:41 2022] GET /identity/v3/role_assignments?user.id=9b5124cfd2724ed1a5fba427dbe3031e&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=397543bbcaeb4ccfb989c8a046f27b2f => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:42.257446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:42.294623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:42.301783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e57f1-b46d-4e53-b829-30227033e714 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:42.365768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:42.366778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.367168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.367547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.386999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:42.389539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:42.395344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:42.409879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78057a-1298-46cb-8727-f0cba781dee4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:42.415527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:42.417485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:42.420480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:42.420480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:42.420480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:42.424862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 305/626] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:42.426307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:42.464559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303fd14-cf42-4623-b77a-278ab8fb4120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:42.465925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303fd14-cf42-4623-b77a-278ab8fb4120 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.465925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303fd14-cf42-4623-b77a-278ab8fb4120 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.466382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303fd14-cf42-4623-b77a-278ab8fb4120 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.467218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303fd14-cf42-4623-b77a-278ab8fb4120 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:42.467766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303fd14-cf42-4623-b77a-278ab8fb4120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:42.471089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303fd14-cf42-4623-b77a-278ab8fb4120 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:42.479233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 322/627] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Oct 28 19:44:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:42.481849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad23a1-176c-422c-b4e5-153698d0283d None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.482241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad23a1-176c-422c-b4e5-153698d0283d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.482623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad23a1-176c-422c-b4e5-153698d0283d None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.484735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 323/628] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:42.486476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad23a1-176c-422c-b4e5-153698d0283d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:42.611825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06360f76-4499-4a4a-b29f-5acb87da893d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:42.657462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:42.658350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.658812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.659238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.660056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:42.662061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:42.677746 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad23a1-176c-422c-b4e5-153698d0283d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:42.695257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 306/629] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:44:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:42.696833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:42.733920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:42.769678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c2927-ec74-4e52-b162-a319ed8bb96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:42.771645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c2927-ec74-4e52-b162-a319ed8bb96a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.772524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c2927-ec74-4e52-b162-a319ed8bb96a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.773260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c2927-ec74-4e52-b162-a319ed8bb96a None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.774821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c2927-ec74-4e52-b162-a319ed8bb96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:42.775581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c2927-ec74-4e52-b162-a319ed8bb96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:42.778317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c2927-ec74-4e52-b162-a319ed8bb96a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:42.800457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 324/630] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:42.803338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27a388-1c3d-4449-b548-b5227048f97d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:42.804181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27a388-1c3d-4449-b548-b5227048f97d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:42.805027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27a388-1c3d-4449-b548-b5227048f97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:42.836447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-be27a388-1c3d-4449-b548-b5227048f97d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:42.840176 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-be27a388-1c3d-4449-b548-b5227048f97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:42.862349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:42.940666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316b927-c14c-4a38-ab0d-c528e8236f21 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:43.010109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 325/631] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:43.011971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27a388-1c3d-4449-b548-b5227048f97d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:43.020518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:43.022387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.023155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.023923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.025361 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:43.026236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:43.030160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:43.043317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 307/632] 10.222.0.52 () {56 vars in 1124 bytes} [Fri Oct 28 19:44:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:43.053664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:43.202399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:43.215719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27a388-1c3d-4449-b548-b5227048f97d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:43.266249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de7496-7090-4f5a-861c-7d561f4b5ce0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:43.291820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:43.292889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.293359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.293878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.307516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:43.310375 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:43.336676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:43.338877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:43.341761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 326/633] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:43.345903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:43.347392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.348167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.348935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.350995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:43.351271 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:43.354327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:43.357468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:43.393591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 308/634] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:44:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:43.558666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:43.579743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7269dda-caf9-4cfd-b641-14a994e8e2a5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:43.652898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:43.654074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.654569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.655178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.656347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:43.656818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:43.661761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:43.687718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 327/635] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:43.694700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:43.762443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fab7b6-3f27-44c0-9bcb-110b15dd87a3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:43.772702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:43.818307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:43.841432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dd0a3-217e-4486-957f-1399d2934e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:43.841432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dd0a3-217e-4486-957f-1399d2934e01 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.841432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dd0a3-217e-4486-957f-1399d2934e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.841432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dd0a3-217e-4486-957f-1399d2934e01 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.841877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dd0a3-217e-4486-957f-1399d2934e01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:43.843855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dd0a3-217e-4486-957f-1399d2934e01 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:43.847618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb27a3-48c1-4627-9c6a-52e7f48608ca None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:43.875033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 309/636] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:44:43 2022] POST /identity/v3/services => generated 269 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:43.923589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e3151-70b1-411d-a19b-c9d9d65a499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:43.924645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e3151-70b1-411d-a19b-c9d9d65a499e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:43.925206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e3151-70b1-411d-a19b-c9d9d65a499e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:43.925789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e3151-70b1-411d-a19b-c9d9d65a499e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:43.927183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e3151-70b1-411d-a19b-c9d9d65a499e None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=5eb5a6ff4af64a9980bcaa49f3c97bba) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:43.927733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e3151-70b1-411d-a19b-c9d9d65a499e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:43.930823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e3151-70b1-411d-a19b-c9d9d65a499e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:43.945414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 328/637] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:43 2022] GET /identity/v3/role_assignments?user.id=5eb5a6ff4af64a9980bcaa49f3c97bba&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:44.765051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287e761-84c6-4147-84c8-d52499cde903 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:44.765961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287e761-84c6-4147-84c8-d52499cde903 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:44.765961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287e761-84c6-4147-84c8-d52499cde903 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:44.767417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 310/638] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:44.774007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b01d4e-b42b-4983-aca0-da6845dea1bc None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:44.775016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b01d4e-b42b-4983-aca0-da6845dea1bc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:44.775016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b01d4e-b42b-4983-aca0-da6845dea1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:44.798099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e2b01d4e-b42b-4983-aca0-da6845dea1bc None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:44.800098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e2b01d4e-b42b-4983-aca0-da6845dea1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:44.940421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 329/639] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:44 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:45.216462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287e761-84c6-4147-84c8-d52499cde903 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:45.362367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287e761-84c6-4147-84c8-d52499cde903 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:45.410930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:45.411585 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:45.417423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:45.417423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:45.426112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:45.431120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:45.433430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:45.435320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 311/640] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Oct 28 19:44:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:45.449419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b01d4e-b42b-4983-aca0-da6845dea1bc None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:45.558751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:45.635086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b01d4e-b42b-4983-aca0-da6845dea1bc None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:45.677303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:45.677965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:45.678239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:45.678508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:45.679181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:45.679477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:45.680930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:45.691129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 330/641] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Oct 28 19:44:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:45.697430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:45.791192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:45.919909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3825a-86d6-4255-a347-0accafa78480 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:45.994345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:45.995409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:45.995917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:45.996397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.008912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:46.010817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:46.030110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:46.031110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:46.032446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:46.032446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:46.032446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:46.032446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 312/642] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:46.037602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.160166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a170d-a1bc-4587-8b6e-caf836aebf3b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:46.174641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:46.201044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502d4be-3499-48bf-9154-9d55a0c70654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:46.201891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502d4be-3499-48bf-9154-9d55a0c70654 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.202173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502d4be-3499-48bf-9154-9d55a0c70654 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.202443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502d4be-3499-48bf-9154-9d55a0c70654 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.203122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502d4be-3499-48bf-9154-9d55a0c70654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:46.203423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502d4be-3499-48bf-9154-9d55a0c70654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:46.204886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502d4be-3499-48bf-9154-9d55a0c70654 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:46.218733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 331/643] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:46.224060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.271503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeceda7-67f8-4e66-9703-2f0838729e06 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.271870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeceda7-67f8-4e66-9703-2f0838729e06 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.272087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeceda7-67f8-4e66-9703-2f0838729e06 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.273753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 332/644] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:46.280099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0578df-dd87-489f-84ce-469cc686ba7a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.280439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0578df-dd87-489f-84ce-469cc686ba7a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.280648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0578df-dd87-489f-84ce-469cc686ba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.301886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7d0578df-dd87-489f-84ce-469cc686ba7a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:46.303231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7d0578df-dd87-489f-84ce-469cc686ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:46.337577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:46.340927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cad52-beb8-48bb-be10-927b1ca8b165 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:46.380183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:46.381091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.381493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.381866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.385863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 333/645] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:46 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:44:46.391811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:46.393627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:46.407577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:46.408589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:46.409900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 313/646] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:46.415670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0578df-dd87-489f-84ce-469cc686ba7a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.526888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:46.530936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0578df-dd87-489f-84ce-469cc686ba7a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:46.571946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:46.572952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.573535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.574070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.575177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:46.575714 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:46.577468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:46.602350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 334/647] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:46.608293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.695977 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.729239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a0b09-271f-41cb-bad8-8eebcd416cbf None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:46.771619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:46.772738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.773256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.773762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.786903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:46.788784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:46.806331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:46.807761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:46.808633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:46.808633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:46.808633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:46.810969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 314/648] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:46.815436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707faa9a-24f9-4a42-8305-2237315d13c2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:46.816992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.834817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:46.860937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:46.862040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.862551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.863037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.863823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:46.865451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:46.876307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:46.877319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:46.878232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:46.886009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 335/649] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:46.887460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:46.918532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:46.943169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a28c0-7753-4e8f-91c2-01fa00de9e3d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:46.983980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:46.984880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:46.985314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:46.985806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:46.986618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:46.987191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:46.988749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.007775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 315/650] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:47.009149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:47.017253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f60493-1591-41d5-9d16-7f40e5de46af None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:47.058940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39e5dd-4404-4e89-b6ef-36e07c4fc2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:47.059891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39e5dd-4404-4e89-b6ef-36e07c4fc2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.060458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39e5dd-4404-4e89-b6ef-36e07c4fc2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.060738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39e5dd-4404-4e89-b6ef-36e07c4fc2a6 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.061501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39e5dd-4404-4e89-b6ef-36e07c4fc2a6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:47.061811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39e5dd-4404-4e89-b6ef-36e07c4fc2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.063916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39e5dd-4404-4e89-b6ef-36e07c4fc2a6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.074591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 336/651] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:47.074591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b63a-f83e-4a00-af9e-7ce101dbd930 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.074591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b63a-f83e-4a00-af9e-7ce101dbd930 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.074591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49b63a-f83e-4a00-af9e-7ce101dbd930 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.077458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 337/652] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:47.077458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b63a-f83e-4a00-af9e-7ce101dbd930 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:47.108246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:47.152386 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c3675d-28b7-4e5b-922e-070b5f68c86f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:47.205089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:47.211136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebc740-297d-49d8-834e-22fbf77f2103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:47.212146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebc740-297d-49d8-834e-22fbf77f2103 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.212550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebc740-297d-49d8-834e-22fbf77f2103 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.212981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebc740-297d-49d8-834e-22fbf77f2103 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.224625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebc740-297d-49d8-834e-22fbf77f2103 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.225100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49b63a-f83e-4a00-af9e-7ce101dbd930 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:47.227069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebc740-297d-49d8-834e-22fbf77f2103 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-15ebc740-297d-49d8-834e-22fbf77f2103 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:47.250090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:47.251024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:47.251899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:47.252322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 316/653] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:47.254181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d048-14eb-4deb-baa3-6f67ac3a4340 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.254665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d048-14eb-4deb-baa3-6f67ac3a4340 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.255109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191d048-14eb-4deb-baa3-6f67ac3a4340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.268944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:47.269600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.269875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.270140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.270781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:47.271394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.272791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.279110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 338/654] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:47.284697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:47.285057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0191d048-14eb-4deb-baa3-6f67ac3a4340 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:47.286867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0191d048-14eb-4deb-baa3-6f67ac3a4340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:47.401040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 317/655] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:47.402159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191d048-14eb-4deb-baa3-6f67ac3a4340 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:47.411054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841e9a6-a64d-4385-999e-7002d4cb2b3c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:47.463232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba6427-d6c3-41eb-9412-849aec4a8181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:47.464148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba6427-d6c3-41eb-9412-849aec4a8181 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.464580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba6427-d6c3-41eb-9412-849aec4a8181 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.465027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba6427-d6c3-41eb-9412-849aec4a8181 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.466254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba6427-d6c3-41eb-9412-849aec4a8181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:47.466778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba6427-d6c3-41eb-9412-849aec4a8181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.469149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba6427-d6c3-41eb-9412-849aec4a8181 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.491355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 339/656] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:47.494567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e40b2-3846-45b7-a444-4f141bda16bd None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.495026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e40b2-3846-45b7-a444-4f141bda16bd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.495490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e40b2-3846-45b7-a444-4f141bda16bd None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.502110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 340/657] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:47.503745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e40b2-3846-45b7-a444-4f141bda16bd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:47.525146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:47.527514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:47.582489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191d048-14eb-4deb-baa3-6f67ac3a4340 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:47.631634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48cfa2-1e13-4c86-9730-f7d302df1534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:47.632785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48cfa2-1e13-4c86-9730-f7d302df1534 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.633225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48cfa2-1e13-4c86-9730-f7d302df1534 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.633524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48cfa2-1e13-4c86-9730-f7d302df1534 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.634258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48cfa2-1e13-4c86-9730-f7d302df1534 None admin] RBAC: Adding query filter params (interface=public, service_id=5157ea6777ec4e5caa7cf15fe9fd8692, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:47.634559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48cfa2-1e13-4c86-9730-f7d302df1534 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.635976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae48cfa2-1e13-4c86-9730-f7d302df1534 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.650573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 318/658] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:44:47 2022] GET /identity/v3/endpoints?service_id=5157ea6777ec4e5caa7cf15fe9fd8692&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:47.650573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395123a5-dc69-46aa-8240-51695b284b2b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.650573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395123a5-dc69-46aa-8240-51695b284b2b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.650573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395123a5-dc69-46aa-8240-51695b284b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.658128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e40b2-3846-45b7-a444-4f141bda16bd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:47.671334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-395123a5-dc69-46aa-8240-51695b284b2b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:47.672849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-395123a5-dc69-46aa-8240-51695b284b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:47.706747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:47.707009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.707285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.707590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/9b5124cfd2724ed1a5fba427dbe3031e/roles/bb69435d22924835a809f5eb32133dec` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.709933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=9b5124cfd2724ed1a5fba427dbe3031e, role_id=bb69435d22924835a809f5eb32133dec)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.711402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.732768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 341/659] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:44:47 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/9b5124cfd2724ed1a5fba427dbe3031e/roles/bb69435d22924835a809f5eb32133dec => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:44:47.733686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:47.785505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 319/660] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:47.845957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:47.885831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7f681-9097-4b07-8d92-b05a3dcc98bf None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:47.926022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395123a5-dc69-46aa-8240-51695b284b2b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:47.929612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:47.930567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:47.930844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:47.931113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:47.932892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:47.934428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:47.940953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 342/661] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:44:47 2022] GET /identity/v3/services => generated 1029 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:44:48.048964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:48.077196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:48.131510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395123a5-dc69-46aa-8240-51695b284b2b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:48.195849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:48.196790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:48.197261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:48.198029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:48.199329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:48.202684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:48.219723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:48.220795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:44:48.221671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:48.226771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea456b8a-b307-4a2a-8195-d5c71ea74a34 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:48.229301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 320/662] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:48.231130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:48.298273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:48.299469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:48.299892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:48.300365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:48.302693 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:48.305413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:48.309582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:48.325433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:48.326697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:48.327704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 343/663] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:44:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:48.339507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:48.409146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995c06a-08b6-4b43-beae-fae959763802 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:48.459133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:48.501556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:48.502759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:48.503288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:48.503812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:48.505017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553268d-a342-4936-afe8-0dd60e90bc64 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:48.505143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:48.505593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:48.509780 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:48.522994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 321/664] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:44:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:48.534766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:48.578607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:48.579968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:48.580465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:48.580929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:48.582753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:48.583971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:48.587006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:48.605537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 344/665] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:44:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:48.612190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:48.695132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:48.750477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a4e4a-a8ef-4649-a1fa-20c697503068 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:48.752648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f827fae-33db-4073-a0d0-3833f67911bb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:48.802828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9d990-e3c9-4fe6-ad77-5196280af562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:48.804071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d990-e3c9-4fe6-ad77-5196280af562 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:48.804653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d990-e3c9-4fe6-ad77-5196280af562 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:48.805180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9d990-e3c9-4fe6-ad77-5196280af562 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:48.806181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d990-e3c9-4fe6-ad77-5196280af562 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:48.806766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d990-e3c9-4fe6-ad77-5196280af562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:48.808573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9d990-e3c9-4fe6-ad77-5196280af562 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:48.821608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 322/666] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:44:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:48.836945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe8b16-2411-4bca-b94d-fe513ee6eece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:48.838075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8b16-2411-4bca-b94d-fe513ee6eece None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:48.838596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8b16-2411-4bca-b94d-fe513ee6eece None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:48.839072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe8b16-2411-4bca-b94d-fe513ee6eece None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:48.839945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8b16-2411-4bca-b94d-fe513ee6eece None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:48.840481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8b16-2411-4bca-b94d-fe513ee6eece None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:48.842263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe8b16-2411-4bca-b94d-fe513ee6eece None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:48.848621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 345/667] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:44:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:50.855604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d209b-54ca-424f-8914-b8504c1d1e1e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:50.857280 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d209b-54ca-424f-8914-b8504c1d1e1e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:50.858238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d209b-54ca-424f-8914-b8504c1d1e1e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:50.861679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 323/668] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:50.870676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b0cf-e3e3-4dfd-9bb8-7b6ec26f77f5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:50.871469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b0cf-e3e3-4dfd-9bb8-7b6ec26f77f5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:50.871606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4b0cf-e3e3-4dfd-9bb8-7b6ec26f77f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:50.907487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-10a4b0cf-e3e3-4dfd-9bb8-7b6ec26f77f5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:50.909643 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-10a4b0cf-e3e3-4dfd-9bb8-7b6ec26f77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:51.043495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 346/669] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:50 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:44:51.208507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966baae8-670c-49da-ba0a-5b9e12e306c2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:51.209040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966baae8-670c-49da-ba0a-5b9e12e306c2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:51.209505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966baae8-670c-49da-ba0a-5b9e12e306c2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:51.211333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 324/670] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:51.217828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed978f-fb7d-46ae-8a64-f9060506d2a6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:51.218492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed978f-fb7d-46ae-8a64-f9060506d2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:51.218978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed978f-fb7d-46ae-8a64-f9060506d2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:51.240242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f6ed978f-fb7d-46ae-8a64-f9060506d2a6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:51.241886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f6ed978f-fb7d-46ae-8a64-f9060506d2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:51.335379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:51.371947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 347/671] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:51 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:44:51.477288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966baae8-670c-49da-ba0a-5b9e12e306c2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:51.588318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:51.647129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed978f-fb7d-46ae-8a64-f9060506d2a6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:51.718163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966baae8-670c-49da-ba0a-5b9e12e306c2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:51.819585 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed978f-fb7d-46ae-8a64-f9060506d2a6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:51.822401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ffca6-f057-4b50-bccf-79d14048422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:51.823782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ffca6-f057-4b50-bccf-79d14048422f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:51.824275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ffca6-f057-4b50-bccf-79d14048422f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:51.824757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ffca6-f057-4b50-bccf-79d14048422f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:51.853457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ffca6-f057-4b50-bccf-79d14048422f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-fe3ffca6-f057-4b50-bccf-79d14048422f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:44:51.868164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:51.871140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:44:51.872878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:51.881747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 325/672] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Oct 28 19:44:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:51.886195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d9e23-b043-4eb4-9405-03fb991b4245 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:51.886623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d9e23-b043-4eb4-9405-03fb991b4245 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:51.887153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d9e23-b043-4eb4-9405-03fb991b4245 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:51.890878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 326/673] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:51.892546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d9e23-b043-4eb4-9405-03fb991b4245 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:51.914080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14408da9-4230-4eac-8dcb-bcda9d329995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:51.915236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408da9-4230-4eac-8dcb-bcda9d329995 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:51.915745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408da9-4230-4eac-8dcb-bcda9d329995 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:51.916282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14408da9-4230-4eac-8dcb-bcda9d329995 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:51.917856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14408da9-4230-4eac-8dcb-bcda9d329995 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:51.920635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14408da9-4230-4eac-8dcb-bcda9d329995 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:51.953466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 348/674] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:44:51 2022] POST /identity/v3/services => generated 241 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:51.953466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4597210-e602-437e-9942-be5c9a59ab5d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:51.953466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4597210-e602-437e-9942-be5c9a59ab5d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:51.953466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4597210-e602-437e-9942-be5c9a59ab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:51.983465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f4597210-e602-437e-9942-be5c9a59ab5d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:51.985087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f4597210-e602-437e-9942-be5c9a59ab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:52.061476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:52.077164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d9e23-b043-4eb4-9405-03fb991b4245 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:52.081240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:52.114691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 349/675] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:51 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:52.117686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d18329-4da1-4ef5-a1f0-50fb1e9a6975 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.118218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d18329-4da1-4ef5-a1f0-50fb1e9a6975 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.118699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d18329-4da1-4ef5-a1f0-50fb1e9a6975 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.121485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 350/676] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:52.132367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b23497-1464-48d4-93e0-9160881ef9fc None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.132857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b23497-1464-48d4-93e0-9160881ef9fc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.133361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b23497-1464-48d4-93e0-9160881ef9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.140443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:52.141563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.142037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.142513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.143754 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:52.144291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:52.147311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:52.161043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-22b23497-1464-48d4-93e0-9160881ef9fc None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:52.162724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-22b23497-1464-48d4-93e0-9160881ef9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:52.169373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 327/677] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Oct 28 19:44:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:52.170959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:52.276364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 351/678] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:52 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:44:52.322268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621f199-32db-40ef-894d-75a6e1e2298b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:52.363245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:52.364260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.364759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.365183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.379464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:52.381426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:52.384228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b23497-1464-48d4-93e0-9160881ef9fc None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:52.403861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:52.405284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:52.406241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:52.406241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:52.406241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:52.406736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 328/679] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:52.413184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:52.439360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:52.537367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2343e3a-69b4-4d75-9393-672d6524c5e2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:52.553284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b23497-1464-48d4-93e0-9160881ef9fc None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:52.564071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:52.579703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:52.580819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.580819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.580998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.581721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:52.582022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:52.583561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:52.596759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:52.597428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.597713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.597984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.598577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:52.599965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:52.605480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 329/680] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:52.605480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:52.615498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:52.616503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:52.617420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 352/681] 10.222.0.52 () {56 vars in 1132 bytes} [Fri Oct 28 19:44:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:52.618258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:52.700809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:52.733575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112941b7-20b9-4534-b2ac-3170c381f555 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:52.754024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1b513-8ff2-4f2d-9642-f6324dd2bd3a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:52.779858 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:52.780489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.780764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.781032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.781759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:52.783213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:52.800499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 330/682] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:44:52 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:52.801404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:52.823271 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:52.824868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:52.825892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:52.826739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:52.847334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:52.850602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:44:52.873763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:52.875571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 28 19:44:52.877432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:52.881854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 353/683] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:44:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:52.893022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:52.922079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:52.995605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3149d-f4dd-4a6d-b250-f1c1b3e3698b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:53.010167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbfdd5-a268-4b9e-a6dd-2c516dd3316a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:53.059172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:53.060150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:53.060738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:53.061176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:53.062989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:53.063458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:53.065307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:53.074798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 331/684] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:53.083879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:53.084321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:53.084870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:53.085139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:53.085448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:53.086208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:53.087244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:53.087984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:53.091140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:53.116802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 354/685] 10.222.0.52 () {56 vars in 1149 bytes} [Fri Oct 28 19:44:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:53.123527 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:53.257772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:53.289798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea4b4e-5219-4702-b1c7-3c9c9a19dfc6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:53.308156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19e674-67f2-4b20-9ea7-4166a1f8a066 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:53.358985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:53.360250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:53.360628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:53.361148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:53.382062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:53.383681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:53.384752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:53.385524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:53.386762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:53.387479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:53.389941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:53.400538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 332/686] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:53.408268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:53.510555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:53.513548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:53.520980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:53.580492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fc876-7fe0-40d6-987f-07767eeb908f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:53.643550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:53.644893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:53.645880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:53.646527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:53.647869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:53.650557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:53.683059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 333/687] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:44:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:44:53.694527 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:53.729874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 355/688] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:44:53 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 19:44:53.738358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:53.874182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b985a5-360f-41bc-906e-d1d007d3ca23 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:53.897715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:53.920787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:53.921635 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:53.921962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:53.922342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:53.934815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:53.936379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:44:53.955240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:53.957082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:44:53.958719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:44:53.958719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:44:53.958719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:53.958719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 334/689] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:53.963573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:54.139361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a37ac-82a0-44fa-87c1-ed7c36ce2820 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:54.182381 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:54.183367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:54.184030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:54.184618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:54.185742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:54.186331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:54.188058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:54.203287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 356/690] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:54.209731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:54.331266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd1eba-b1b5-4036-afc5-9a5d990dbef4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:54.373254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:54.374409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:54.374898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:54.375360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:54.384270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:54.386083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:44:54.399620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:54.400579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:44:54.401559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:54.403285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 335/691] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:54.410387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:54.467970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:54.533785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c26ef-bd77-46a6-93bb-3d75b6ce8e53 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:54.576413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696476b-24d4-4698-8892-37a22a7d8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:54.577484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696476b-24d4-4698-8892-37a22a7d8740 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:54.577963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696476b-24d4-4698-8892-37a22a7d8740 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:54.578400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696476b-24d4-4698-8892-37a22a7d8740 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:54.579339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696476b-24d4-4698-8892-37a22a7d8740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:54.579858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696476b-24d4-4698-8892-37a22a7d8740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:54.581577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696476b-24d4-4698-8892-37a22a7d8740 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:54.597334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 357/692] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:44:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:54.604010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:54.659218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:54.725495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46630e1-59ee-4c85-9113-8f21dcc5566f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:54.767499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c124b02-3eba-49e9-bf90-7ba331eb10cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:54.768438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124b02-3eba-49e9-bf90-7ba331eb10cd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:54.768914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124b02-3eba-49e9-bf90-7ba331eb10cd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:54.769350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c124b02-3eba-49e9-bf90-7ba331eb10cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:54.770292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c124b02-3eba-49e9-bf90-7ba331eb10cd None admin] RBAC: Adding query filter params (role.id=bb69435d22924835a809f5eb32133dec, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=9b5124cfd2724ed1a5fba427dbe3031e) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:54.771081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c124b02-3eba-49e9-bf90-7ba331eb10cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:54.772827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c124b02-3eba-49e9-bf90-7ba331eb10cd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:54.780824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 336/693] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:44:54 2022] GET /identity/v3/role_assignments?user.id=9b5124cfd2724ed1a5fba427dbe3031e&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=bb69435d22924835a809f5eb32133dec => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:55.391505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f794927-e46f-44d1-9802-64a619dab417 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:55.392627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f794927-e46f-44d1-9802-64a619dab417 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:55.393121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f794927-e46f-44d1-9802-64a619dab417 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:55.395165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 358/694] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:44:55.402162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb61b8-3443-4ad9-8467-5d1eaf5652e8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:55.403217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb61b8-3443-4ad9-8467-5d1eaf5652e8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:55.403703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb61b8-3443-4ad9-8467-5d1eaf5652e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:55.426268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9deb61b8-3443-4ad9-8467-5d1eaf5652e8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:55.428039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9deb61b8-3443-4ad9-8467-5d1eaf5652e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:55.512349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 337/695] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:55.788566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f794927-e46f-44d1-9802-64a619dab417 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:55.913414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f794927-e46f-44d1-9802-64a619dab417 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:55.916797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:55.960128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2c6c2-81bf-4fd9-a748-8ef7ad269f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:55.960853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c6c2-81bf-4fd9-a748-8ef7ad269f2e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:55.961147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c6c2-81bf-4fd9-a748-8ef7ad269f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:55.961433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2c6c2-81bf-4fd9-a748-8ef7ad269f2e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:55.962066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2c6c2-81bf-4fd9-a748-8ef7ad269f2e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:55.963593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2c6c2-81bf-4fd9-a748-8ef7ad269f2e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-1da2c6c2-81bf-4fd9-a748-8ef7ad269f2e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:55.974236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:55.976430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:44:55.978792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 359/696] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:44:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:55.985423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb61b8-3443-4ad9-8467-5d1eaf5652e8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:56.011380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:56.084778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1243d-5eb7-44a0-90dd-f3c85ad61b78 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.085103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1243d-5eb7-44a0-90dd-f3c85ad61b78 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.085363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1243d-5eb7-44a0-90dd-f3c85ad61b78 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.087025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 360/697] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:44:56.093440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f942-080f-4965-9342-2d0d61981f5a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.093851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f942-080f-4965-9342-2d0d61981f5a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.094085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d71f942-080f-4965-9342-2d0d61981f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.105110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb61b8-3443-4ad9-8467-5d1eaf5652e8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:56.115002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0d71f942-080f-4965-9342-2d0d61981f5a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:56.116353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0d71f942-080f-4965-9342-2d0d61981f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:56.144237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:56.144955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.145231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.149428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.149428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:56.149428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:56.149428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:56.155205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 338/698] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:44:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:56.161208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:56.221412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 361/699] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:44:56.278101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:56.289441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b285f-01a8-4824-8245-09e263c3b7c7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:56.330240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:56.330944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.331217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.331482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.332131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:56.332428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:56.333892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:56.340437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 339/700] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:44:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:56.350689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71f942-080f-4965-9342-2d0d61981f5a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:56.467378 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:56.471977 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d71f942-080f-4965-9342-2d0d61981f5a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:56.506649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:56.539095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:56.540632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.541164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.541793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.544117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] RBAC: Adding query filter params (interface=public, service_id=3bad5cef234248929ec2cb0f199e09a2, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:56.544986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:56.549129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:56.568070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 362/701] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:44:56 2022] GET /identity/v3/endpoints?service_id=3bad5cef234248929ec2cb0f199e09a2&interface=public®ion_id=RegionOne => generated 194 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:56.574551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:56.653675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d99f7-96a7-435e-a913-80f518128643 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:56.695176 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97893dd-4825-41f4-bdfd-8dc3c3142894 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:56.702102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:56.702773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.703046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.703308 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.703889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:56.706071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:56.718506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:56.719613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:44:56.720445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:56.727863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 340/702] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:44:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:44:56.735357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:56.748546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:56.749285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.749740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.750632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.750866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:56.752535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:56.765414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 363/703] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:44:56 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:44:56.768159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:56.873634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384d614-bfa6-4f17-88ab-d48b6896edb0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:56.916602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:56.917138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:56.917429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:56.917701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:56.918341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:56.918636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:56.920131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:56.926480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 341/704] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:44:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:56.932535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:56.971483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:57.061887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e95ec-e33b-42fb-9391-92233e22a617 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:57.101698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:57.102395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.102668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.102931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.103574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:57.103879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:57.105364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:57.111715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 364/705] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:44:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:57.118484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:57.228969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:57.251677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa1baaa-fbda-449c-8a0e-3546e2e2a12a None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:57.291889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041a5b9-437d-4403-b52d-01980321b730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:57.292544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a5b9-437d-4403-b52d-01980321b730 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.292818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a5b9-437d-4403-b52d-01980321b730 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.293079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a5b9-437d-4403-b52d-01980321b730 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.293851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041a5b9-437d-4403-b52d-01980321b730 None admin] RBAC: Adding query filter params (interface=public, service_id=a9c46c2a65e148908e97a85c0f8f8179, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:57.294162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041a5b9-437d-4403-b52d-01980321b730 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:57.295850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041a5b9-437d-4403-b52d-01980321b730 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:57.302865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 342/706] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:44:57 2022] GET /identity/v3/endpoints?service_id=a9c46c2a65e148908e97a85c0f8f8179&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:44:57.309639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:57.423059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:57.435194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03b6a1-f3b6-4dc4-ba21-6ace8dd8347e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:57.475881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5451ab4-03ad-4bbc-947f-6ca60403ed64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:57.476573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5451ab4-03ad-4bbc-947f-6ca60403ed64 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.476820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5451ab4-03ad-4bbc-947f-6ca60403ed64 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.477041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5451ab4-03ad-4bbc-947f-6ca60403ed64 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.477687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5451ab4-03ad-4bbc-947f-6ca60403ed64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:57.479185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5451ab4-03ad-4bbc-947f-6ca60403ed64 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:57.487273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 365/707] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:44:57 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:44:57.525443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494334-113d-44fe-902f-036b351fbc3a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.526023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494334-113d-44fe-902f-036b351fbc3a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.526417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494334-113d-44fe-902f-036b351fbc3a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.529593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 343/708] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:57.539219 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd26a-748e-4ee8-99aa-482d3c2d4876 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.539737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd26a-748e-4ee8-99aa-482d3c2d4876 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.540245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cd26a-748e-4ee8-99aa-482d3c2d4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.573519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-501cd26a-748e-4ee8-99aa-482d3c2d4876 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:57.575966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-501cd26a-748e-4ee8-99aa-482d3c2d4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:57.731782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 366/709] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:57.874380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abf461-5b29-4291-b789-8fcc544aafda None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.874696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abf461-5b29-4291-b789-8fcc544aafda None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.874978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abf461-5b29-4291-b789-8fcc544aafda None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.876887 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 344/710] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:44:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:44:57.883111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fea9e-deec-482a-bfe7-6598c9353494 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:57.883428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fea9e-deec-482a-bfe7-6598c9353494 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:57.883745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fea9e-deec-482a-bfe7-6598c9353494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:57.905478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ee8fea9e-deec-482a-bfe7-6598c9353494 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:44:57.906787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ee8fea9e-deec-482a-bfe7-6598c9353494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:44:58.045209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 367/711] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:44:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:44:58.228855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abf461-5b29-4291-b789-8fcc544aafda None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:58.402922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abf461-5b29-4291-b789-8fcc544aafda None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:58.442856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:58.443524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:58.443799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:58.444062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:58.444765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:58.446666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:58.456904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:58.459261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:58.461820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 345/712] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:44:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:58.468698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fea9e-deec-482a-bfe7-6598c9353494 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:58.497940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:58.554637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:58.577853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:58.666760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fea9e-deec-482a-bfe7-6598c9353494 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:58.739627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e3b30-f246-43b0-9751-a4f5e7c2eef5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:58.742460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:58.745118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:58.745781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:58.746432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:58.747813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:58.748471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:58.752399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:58.767269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 368/713] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:58.773269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:58.789801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:58.790776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:58.791229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:58.791677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] PATH_INFO: `/v3/services/image` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:58.792634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:58.794608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:44:58.805468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:44:58.806545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:44:58.807429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:44:58.813791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 346/714] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Oct 28 19:44:58 2022] GET /identity/v3/services/image => generated 86 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:44:58.817155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:58.912902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:58.955541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5acc23-3790-40e3-8552-0ab790f49782 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:59.002377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91753-e954-4732-9987-165233d29842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:59.003056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91753-e954-4732-9987-165233d29842 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:59.003335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91753-e954-4732-9987-165233d29842 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:59.003628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c91753-e954-4732-9987-165233d29842 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:59.004297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91753-e954-4732-9987-165233d29842 None admin] RBAC: Adding query filter params (name=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:59.004633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91753-e954-4732-9987-165233d29842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:59.006209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c91753-e954-4732-9987-165233d29842 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:59.013158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 347/715] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:59.019235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91753-e954-4732-9987-165233d29842 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:44:59.042289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:59.075601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a89f-eb39-4882-80d6-a8380f0ca6fc None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:59.138750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6f7a3-3866-49dc-9467-55a2aa55841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:59.139420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f7a3-3866-49dc-9467-55a2aa55841b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:59.139753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f7a3-3866-49dc-9467-55a2aa55841b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:59.140021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6f7a3-3866-49dc-9467-55a2aa55841b None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:59.140734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6f7a3-3866-49dc-9467-55a2aa55841b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:59.141039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6f7a3-3866-49dc-9467-55a2aa55841b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:59.143589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6f7a3-3866-49dc-9467-55a2aa55841b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:59.153440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 369/716] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:44:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:44:59.170549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c91753-e954-4732-9987-165233d29842 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:44:59.214705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf48cff-08ec-48f0-b969-70a1f1631dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:44:59.215260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48cff-08ec-48f0-b969-70a1f1631dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:44:59.215540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48cff-08ec-48f0-b969-70a1f1631dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:44:59.215812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf48cff-08ec-48f0-b969-70a1f1631dd8 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:44:59.216548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48cff-08ec-48f0-b969-70a1f1631dd8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:44:59.216849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48cff-08ec-48f0-b969-70a1f1631dd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:44:59.218380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf48cff-08ec-48f0-b969-70a1f1631dd8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:44:59.221193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:44:59.230212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 348/717] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:44:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:00.084068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b41b6-76e7-4e05-a5bf-f44f98b28959 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:00.084638 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b41b6-76e7-4e05-a5bf-f44f98b28959 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:00.085131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b41b6-76e7-4e05-a5bf-f44f98b28959 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:00.087828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 370/718] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:00.097365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c24479-c439-47c3-992d-488fc90afc48 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:00.097920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c24479-c439-47c3-992d-488fc90afc48 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:00.098249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c24479-c439-47c3-992d-488fc90afc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:00.129980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-57c24479-c439-47c3-992d-488fc90afc48 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:00.132099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-57c24479-c439-47c3-992d-488fc90afc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:00.230617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 349/719] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:00.734817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b41b6-76e7-4e05-a5bf-f44f98b28959 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:00.866578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b41b6-76e7-4e05-a5bf-f44f98b28959 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:00.909897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:00.910550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:00.910825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:00.911094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:00.911721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:00.913200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:00.917297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5fe5-ea02-433d-8d27-886e0fa9b417 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:00.917948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5fe5-ea02-433d-8d27-886e0fa9b417 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:00.917948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b5fe5-ea02-433d-8d27-886e0fa9b417 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:00.919871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 350/720] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:00.925720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868a76-4f56-42cd-8784-90a73b22db16 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:00.926090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868a76-4f56-42cd-8784-90a73b22db16 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:00.926345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd868a76-4f56-42cd-8784-90a73b22db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:00.934191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:00.936190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:00.937918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:00.943247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 371/721] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:45:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:00.951911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cd868a76-4f56-42cd-8784-90a73b22db16 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:00.951911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cd868a76-4f56-42cd-8784-90a73b22db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:00.952355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:00.970031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:01.088121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 351/722] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:45:01.161331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47bcba-daee-4ae4-92bb-fd0de03befe4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:01.228970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:01.230066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:01.230544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:01.231104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:01.232334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:01.232854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:01.235475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:01.249567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 372/723] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:45:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:01.255166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd868a76-4f56-42cd-8784-90a73b22db16 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:01.380260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:01.386389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:01.441611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd868a76-4f56-42cd-8784-90a73b22db16 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:01.490374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:01.491244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:01.491577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:01.491942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:01.492741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:01.493202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:01.494836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:01.501507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 352/724] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:45:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:01.507734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:01.549410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:01.607369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa6530-df75-4588-9605-ea3d59ee593a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:01.632209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d186f52-b9ec-4d42-bfd4-3c3c74d54f14 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:01.662122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:01.671681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860b8e3-791a-477f-aecf-9ae0033ffa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:01.672880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860b8e3-791a-477f-aecf-9ae0033ffa91 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:01.673312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860b8e3-791a-477f-aecf-9ae0033ffa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:01.673871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860b8e3-791a-477f-aecf-9ae0033ffa91 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:01.675002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860b8e3-791a-477f-aecf-9ae0033ffa91 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:01.676654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984d988-743d-40e7-b62a-1ecf0769706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:01.677242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984d988-743d-40e7-b62a-1ecf0769706f None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:01.677573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984d988-743d-40e7-b62a-1ecf0769706f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:01.677788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860b8e3-791a-477f-aecf-9ae0033ffa91 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:01.677915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984d988-743d-40e7-b62a-1ecf0769706f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:01.678568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984d988-743d-40e7-b62a-1ecf0769706f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:01.680035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984d988-743d-40e7-b62a-1ecf0769706f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5860b8e3-791a-477f-aecf-9ae0033ffa91 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:01.696286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:01.698022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:01.702146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 373/725] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:45:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:01.702971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76159-72e8-42b2-b0a9-ef3c3f7160a4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:01.702971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76159-72e8-42b2-b0a9-ef3c3f7160a4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:01.702971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76159-72e8-42b2-b0a9-ef3c3f7160a4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:01.705205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 374/726] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:01.706770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76159-72e8-42b2-b0a9-ef3c3f7160a4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:01.724850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 353/727] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:45:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:45:01.726630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34ed29-2b15-401e-8780-972d512df0f4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:01.727139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34ed29-2b15-401e-8780-972d512df0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:01.727602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34ed29-2b15-401e-8780-972d512df0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:01.757661 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ba34ed29-2b15-401e-8780-972d512df0f4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:01.759345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ba34ed29-2b15-401e-8780-972d512df0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:01.885768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 354/728] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:01.897296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76159-72e8-42b2-b0a9-ef3c3f7160a4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:01.942069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:01.942791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:01.943071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:01.943343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:01.944137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:01.944508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:01.946140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:01.947765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:01.954280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 375/729] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:45:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:01.960579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34ed29-2b15-401e-8780-972d512df0f4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:02.090481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34ed29-2b15-401e-8780-972d512df0f4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:02.100402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:02.136147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639b272-b199-49b8-a209-90526b79364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:02.136715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b272-b199-49b8-a209-90526b79364e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.136997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b272-b199-49b8-a209-90526b79364e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.137305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639b272-b199-49b8-a209-90526b79364e None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.138058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b272-b199-49b8-a209-90526b79364e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:02.138378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b272-b199-49b8-a209-90526b79364e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:02.140056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639b272-b199-49b8-a209-90526b79364e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:02.147075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 355/730] 10.222.0.52 () {56 vars in 1114 bytes} [Fri Oct 28 19:45:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:02.154115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:02.159720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e32d-ec4a-4f62-887f-bf08da9349ae None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.160011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e32d-ec4a-4f62-887f-bf08da9349ae None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.160390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e32d-ec4a-4f62-887f-bf08da9349ae None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.162115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 356/731] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:02.168440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d744e6-c8b6-47de-9fca-c944bbc04079 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.168757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d744e6-c8b6-47de-9fca-c944bbc04079 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.169003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d744e6-c8b6-47de-9fca-c944bbc04079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.191406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b4d744e6-c8b6-47de-9fca-c944bbc04079 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:02.192702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b4d744e6-c8b6-47de-9fca-c944bbc04079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:02.278934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 357/732] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:45:02.286812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d744e6-c8b6-47de-9fca-c944bbc04079 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:02.353105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c242a8c2-b79a-4c07-8d0b-a1efcd62280e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:02.421669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:02.423171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.423937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.424674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.424829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:02.427600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:02.429141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d744e6-c8b6-47de-9fca-c944bbc04079 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:02.431467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:02.470329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 376/733] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:45:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:45:02.508202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fbb1b-02ac-4e4c-9f2e-87a7d55c94ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:02.509350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fbb1b-02ac-4e4c-9f2e-87a7d55c94ef None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.509943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fbb1b-02ac-4e4c-9f2e-87a7d55c94ef None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.510522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fbb1b-02ac-4e4c-9f2e-87a7d55c94ef None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.511830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fbb1b-02ac-4e4c-9f2e-87a7d55c94ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:02.515416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fbb1b-02ac-4e4c-9f2e-87a7d55c94ef None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:02.553721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 358/734] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:45:02 2022] POST /identity/v3/services => generated 242 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:45:02.563859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:02.707254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:02.807116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb35b27-9883-4e54-b5fd-765a96d228c7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:02.866851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42384419-6151-4806-9bb4-35c6915daced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:02.867487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42384419-6151-4806-9bb4-35c6915daced None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:02.867766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42384419-6151-4806-9bb4-35c6915daced None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:02.868030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42384419-6151-4806-9bb4-35c6915daced None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:02.868786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42384419-6151-4806-9bb4-35c6915daced None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:02.870239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42384419-6151-4806-9bb4-35c6915daced None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:02.888989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 377/735] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:45:02 2022] POST /identity/v3/services => generated 242 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:45:04.649266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa992d2f-8655-4ecc-9cc0-1f256072c160 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:04.649846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa992d2f-8655-4ecc-9cc0-1f256072c160 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:04.649846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa992d2f-8655-4ecc-9cc0-1f256072c160 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:04.651616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 359/736] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:04.658532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c68a-a3c4-463a-956c-55c16867763c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:04.659080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c68a-a3c4-463a-956c-55c16867763c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:04.659154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3c68a-a3c4-463a-956c-55c16867763c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:04.681835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-23e3c68a-a3c4-463a-956c-55c16867763c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:04.683205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-23e3c68a-a3c4-463a-956c-55c16867763c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:04.826423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 378/737] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:04 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:04.995710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979a1a-1f0a-4e4a-a48d-24afe8d39925 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:04.995997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979a1a-1f0a-4e4a-a48d-24afe8d39925 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:04.996357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a979a1a-1f0a-4e4a-a48d-24afe8d39925 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:04.998090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 360/738] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:05.005341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a56a3-39cb-44da-95fa-39810c370ae3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.005848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a56a3-39cb-44da-95fa-39810c370ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.006596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a56a3-39cb-44da-95fa-39810c370ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.035848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-446a56a3-39cb-44da-95fa-39810c370ae3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:05.038831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-446a56a3-39cb-44da-95fa-39810c370ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:05.097101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:05.114278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979a1a-1f0a-4e4a-a48d-24afe8d39925 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:05.185411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 379/739] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:05 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:05.291396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a979a1a-1f0a-4e4a-a48d-24afe8d39925 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:05.367863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd900965-83fc-43c4-850c-76c9bf65b190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:05.368988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900965-83fc-43c4-850c-76c9bf65b190 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.369606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900965-83fc-43c4-850c-76c9bf65b190 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.370006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd900965-83fc-43c4-850c-76c9bf65b190 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.371162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900965-83fc-43c4-850c-76c9bf65b190 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:05.374105 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd900965-83fc-43c4-850c-76c9bf65b190 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-bd900965-83fc-43c4-850c-76c9bf65b190 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:05.391868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:05.392967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:05.394199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.395929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 361/740] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:45:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:05.403755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a56a3-39cb-44da-95fa-39810c370ae3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:05.444725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb208-d3b5-47ed-a530-0894dc7cf77e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.445175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb208-d3b5-47ed-a530-0894dc7cf77e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.445668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5eb208-d3b5-47ed-a530-0894dc7cf77e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.450332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 362/741] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:05.459768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b208e0-32d3-4069-b189-c1dd0da0e022 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.460696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b208e0-32d3-4069-b189-c1dd0da0e022 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.461476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b208e0-32d3-4069-b189-c1dd0da0e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.495832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-39b208e0-32d3-4069-b189-c1dd0da0e022 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:05.498534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-39b208e0-32d3-4069-b189-c1dd0da0e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:05.523767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:05.557005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a56a3-39cb-44da-95fa-39810c370ae3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:05.615839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 363/742] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:05 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:45:05.617051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b208e0-32d3-4069-b189-c1dd0da0e022 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:05.624870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:05.625978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.626622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.627101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.628018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:05.628618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:05.630355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:05.643251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 380/743] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:45:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:05.646098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:05.694602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:05.784634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa4681-cd94-4967-9b5d-b2e4237437ca None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:05.794909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b208e0-32d3-4069-b189-c1dd0da0e022 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:05.835641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6e7a3-3bab-4e1a-bb5d-c1b3e06cba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:05.836258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6e7a3-3bab-4e1a-bb5d-c1b3e06cba76 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.836683 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6e7a3-3bab-4e1a-bb5d-c1b3e06cba76 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.837024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6e7a3-3bab-4e1a-bb5d-c1b3e06cba76 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.837953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6e7a3-3bab-4e1a-bb5d-c1b3e06cba76 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:05.841185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6e7a3-3bab-4e1a-bb5d-c1b3e06cba76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:05.841185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6e7a3-3bab-4e1a-bb5d-c1b3e06cba76 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:05.844930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:05.845905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.846344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.846825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.848365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:05.850229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:05.853137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING keystone.server.flask.common [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 28 19:45:05.854166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 381/744] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:45:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:05.856554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a539c1c-7822-42a5-8355-523f83a2698c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.856993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a539c1c-7822-42a5-8355-523f83a2698c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.857487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a539c1c-7822-42a5-8355-523f83a2698c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.859470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 382/745] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:05.861002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a539c1c-7822-42a5-8355-523f83a2698c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:05.879821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.sql.core [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 19:45:05.879821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:45:05.879821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [parameters: {'id': 'd575adfeb9ca42d3bcf1c5d953630d8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 19:45:05.879821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81546) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-2e6d15b9-3195-42ad-b03c-5f4704807032 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d575adfeb9ca42d3bcf1c5d953630d8c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d575adfeb9ca42d3bcf1c5d953630d8c. Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:45:05.894076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 19:45:05.895460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application yield resource Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise self.value Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application session.commit() Oct 28 19:45:05.896504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:45:05.897605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:45:05.899646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:45:05.901632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [parameters: {'id': 'd575adfeb9ca42d3bcf1c5d953630d8c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:05.903992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:05.906045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d575adfeb9ca42d3bcf1c5d953630d8c. Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 364/746] 10.222.0.52 () {60 vars in 1140 bytes} [Fri Oct 28 19:45:05 2022] POST /identity/v3/projects => generated 262 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cd58b-55d5-4136-9fab-3978542107d4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:05.908395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cd58b-55d5-4136-9fab-3978542107d4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:05.910681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582cd58b-55d5-4136-9fab-3978542107d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:05.922881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:05.931551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-582cd58b-55d5-4136-9fab-3978542107d4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:05.934385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-582cd58b-55d5-4136-9fab-3978542107d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:06.019875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 365/747] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:05 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:06.021427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cd58b-55d5-4136-9fab-3978542107d4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.030743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:06.046002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a539c1c-7822-42a5-8355-523f83a2698c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.102223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.102966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.103396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.103952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.105019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] RBAC: Adding query filter params (interface=admin, service_id=3bad5cef234248929ec2cb0f199e09a2, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:06.105575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.107407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.120617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 383/748] 10.222.0.52 () {56 vars in 1249 bytes} [Fri Oct 28 19:45:05 2022] GET /identity/v3/endpoints?service_id=3bad5cef234248929ec2cb0f199e09a2&interface=admin®ion_id=RegionOne => generated 193 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:06.120617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.171052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582cd58b-55d5-4136-9fab-3978542107d4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.222327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.224030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.224609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.225136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.229850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:06.235870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.240173 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.253041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd54b45-886a-4084-890b-2e5e43f15626 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:45:06.261193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:06.262211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:45:06.263177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:06.264055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 366/749] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:06.269458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.309757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.310418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.310697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.310967 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] PATH_INFO: `/v3/services/image` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.311564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.312967 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:06.324062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:06.326138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:06.328546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 384/750] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:06.331015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.357049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:06.390599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3b869-6fc9-4463-8530-e2f5a34c2a14 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.429029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.429689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.429968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.430303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.431012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.432528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.442677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 367/751] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:45:06.443304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d24810-89c2-468b-b310-5446a550d568 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.443591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.511731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.512666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.513259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.513718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.514920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:06.515423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.518010 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.541507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:06.561426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 385/752] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:06.561426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.627429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e45a13-74ab-4e6b-a56e-69b3d73f24f9 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.696550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.697281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.697690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.698020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] PATH_INFO: `/v3/services/compute` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.698962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.701458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.708971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:06.720333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:06.723064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:06.724017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 368/753] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:06.726994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.755822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0841a3c-8a6c-4576-b733-298e170cb30a None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.818960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.819599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.820853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.821168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.823249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] RBAC: Adding query filter params (name=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:06.823249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.825432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.833267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 386/754] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:06.840123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:06.885233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35823a7e-52a5-43d6-91da-e69e7753a6df None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:06.937470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:06.951714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:06.952709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:06.953177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:06.953675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:06.954718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:06.955484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:06.958339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:06.968598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 369/755] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:06.980586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:07.038247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19238a7-4334-4b3b-8f80-fa17034a77cb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:07.118231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:07.120989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.121766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.122476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:07.123823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] RBAC: Adding query filter params (type=image) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:07.124523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:07.127161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:07.142191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 387/756] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:07.147603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:07.172525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:07.193708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28ff46-ea82-4e51-85b5-83b5fc82276c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:07.265558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:07.266535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.267010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.267470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:07.268593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:07.269102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:07.272333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:07.290733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 370/757] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:45:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:07.293078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:07.341908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8789d8-9176-42cb-ba30-78b6eb299585 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:07.394480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:07.395745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.396185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.396609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:07.397551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] RBAC: Adding query filter params (interface=public, service_id=5e7918ae6717447daa3bea22dc1ad29e, region_id=RegionOne) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:07.398054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:07.399631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:07.406341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 388/758] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:45:07 2022] GET /identity/v3/endpoints?service_id=5e7918ae6717447daa3bea22dc1ad29e&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:07.418204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:07.422340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:07.490801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f458918-0342-455f-b924-0fac9fb04c6d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:07.563339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:07.564787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.566564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.567263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:07.569248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] RBAC: Adding query filter params (interface=public, service_id=8466e237f7ff4fc4bb6633cc2a4fa1f0, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:07.570039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:07.574949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:07.584983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:07.591772 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 371/759] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:45:07 2022] GET /identity/v3/endpoints?service_id=8466e237f7ff4fc4bb6633cc2a4fa1f0&interface=public®ion_id=RegionOne => generated 194 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:07.602068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:07.646382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce4c76-48eb-4225-8fd8-2c5beb8a080e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:07.714887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42907241-4144-493b-87b0-fe6028e89ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:07.715952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907241-4144-493b-87b0-fe6028e89ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.716368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907241-4144-493b-87b0-fe6028e89ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.716886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907241-4144-493b-87b0-fe6028e89ce0 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:07.718027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42907241-4144-493b-87b0-fe6028e89ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:07.720558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42907241-4144-493b-87b0-fe6028e89ce0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:07.741419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 389/760] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:45:07 2022] GET /identity/v3/services => generated 1957 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:45:07.839645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd344073-54de-446d-9c3e-8c11f86cd362 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:07.879621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:07.921994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b18a7-15d7-4494-b69d-d37f1f45f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:07.923187 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b18a7-15d7-4494-b69d-d37f1f45f9da None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:07.923694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b18a7-15d7-4494-b69d-d37f1f45f9da None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:07.924180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b18a7-15d7-4494-b69d-d37f1f45f9da None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:07.925304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b18a7-15d7-4494-b69d-d37f1f45f9da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:07.927949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b18a7-15d7-4494-b69d-d37f1f45f9da None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:07.943166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 372/761] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:45:07 2022] GET /identity/v3/services => generated 1957 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:45:08.891436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17ff5-cbb1-4526-8c88-df5fe77ebf6c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:08.892483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17ff5-cbb1-4526-8c88-df5fe77ebf6c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:08.893113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17ff5-cbb1-4526-8c88-df5fe77ebf6c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:08.895540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 390/762] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:08.902110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdfe8-af91-4bf8-a375-ce8fc5c5f25b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:08.902739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdfe8-af91-4bf8-a375-ce8fc5c5f25b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:08.903291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bdfe8-af91-4bf8-a375-ce8fc5c5f25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:08.924388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f97bdfe8-af91-4bf8-a375-ce8fc5c5f25b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:08.926482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f97bdfe8-af91-4bf8-a375-ce8fc5c5f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:09.036398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 373/763] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:08 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:09.310972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17ff5-cbb1-4526-8c88-df5fe77ebf6c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:09.489533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17ff5-cbb1-4526-8c88-df5fe77ebf6c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:09.555106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:09.555786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:09.556067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:09.556324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:09.556911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:09.558846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:09.568677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:09.569756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 28 19:45:09.570795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:09.573474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 391/764] 10.222.0.52 () {56 vars in 1126 bytes} [Fri Oct 28 19:45:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:09.579499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdfe8-af91-4bf8-a375-ce8fc5c5f25b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:09.957485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bdfe8-af91-4bf8-a375-ce8fc5c5f25b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:09.979292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:10.031990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e992a7-9e01-4742-8e28-9c9ef7d71cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:10.033054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e992a7-9e01-4742-8e28-9c9ef7d71cbd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.033589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e992a7-9e01-4742-8e28-9c9ef7d71cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.034070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e992a7-9e01-4742-8e28-9c9ef7d71cbd None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.035208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e992a7-9e01-4742-8e28-9c9ef7d71cbd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:10.035746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e992a7-9e01-4742-8e28-9c9ef7d71cbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:10.038379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e992a7-9e01-4742-8e28-9c9ef7d71cbd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:10.048964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 374/765] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:45:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:10.054477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:10.074274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:10.187289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e12ed-1609-423f-9859-a691b11a037c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:10.190919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e08d-1927-4894-9ecf-cd19a06cf8ca None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.191395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e08d-1927-4894-9ecf-cd19a06cf8ca None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.191869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628e08d-1927-4894-9ecf-cd19a06cf8ca None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.194923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 375/766] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:10.204236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a346f0-60f9-4c06-861f-117c1a27fc8c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.204711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a346f0-60f9-4c06-861f-117c1a27fc8c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.205174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a346f0-60f9-4c06-861f-117c1a27fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.233730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:10.234748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.235263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.235722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.236583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:10.237091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:10.238753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:10.241930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-92a346f0-60f9-4c06-861f-117c1a27fc8c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:10.244025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-92a346f0-60f9-4c06-861f-117c1a27fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:10.245633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 392/767] 10.222.0.52 () {56 vars in 1122 bytes} [Fri Oct 28 19:45:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:10.252087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:10.342151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:10.390414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb904b-9da5-4d3d-8ff4-26cd6c682a74 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:10.406127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 376/768] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:10.431048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f051d53-d241-48f7-b32d-11173c4c74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:10.431735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051d53-d241-48f7-b32d-11173c4c74aa None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.432015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051d53-d241-48f7-b32d-11173c4c74aa None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.432285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f051d53-d241-48f7-b32d-11173c4c74aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.432994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f051d53-d241-48f7-b32d-11173c4c74aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:10.434606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f051d53-d241-48f7-b32d-11173c4c74aa None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:10.451052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda50a-51db-47c0-b941-d2f0a2c6ea4e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.451249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda50a-51db-47c0-b941-d2f0a2c6ea4e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.451555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dda50a-51db-47c0-b941-d2f0a2c6ea4e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.454962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 393/770] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:45:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:45:10.455163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 377/770] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:10.459512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef7042-b94f-4869-a5f1-4754caba33c5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.459835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef7042-b94f-4869-a5f1-4754caba33c5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.460081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef7042-b94f-4869-a5f1-4754caba33c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.481966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8cef7042-b94f-4869-a5f1-4754caba33c5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:10.483678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8cef7042-b94f-4869-a5f1-4754caba33c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:10.651005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 394/771] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:10.744577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade99ac-d9e7-422e-a6b2-c6c8bc26d71f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.744889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade99ac-d9e7-422e-a6b2-c6c8bc26d71f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.745069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade99ac-d9e7-422e-a6b2-c6c8bc26d71f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.746885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 378/772] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:10.752902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cad81-53c3-4292-b43b-b92e19e62b82 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:10.753447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cad81-53c3-4292-b43b-b92e19e62b82 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:10.753901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cad81-53c3-4292-b43b-b92e19e62b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:10.774725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-372cad81-53c3-4292-b43b-b92e19e62b82 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:10.776387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-372cad81-53c3-4292-b43b-b92e19e62b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:10.800203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade99ac-d9e7-422e-a6b2-c6c8bc26d71f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:10.840969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:10.872285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 395/773] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:10.938318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cad81-53c3-4292-b43b-b92e19e62b82 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.009023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade99ac-d9e7-422e-a6b2-c6c8bc26d71f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.013086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:11.057653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.058739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.059254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.059689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.060580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.062408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.078541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cad81-53c3-4292-b43b-b92e19e62b82 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.079162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.sql.core [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 19:45:11.079162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 19:45:11.079162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [parameters: {'user_id': 'ede8d4812bdf49599f822bb500af9162', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 19:45:11.079162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81546) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:45:11.087604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:45:11.088927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application yield resource Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise self.value Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application session.commit() Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:45:11.089949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:45:11.090971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:45:11.091891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:45:11.092731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ede8d4812bdf49599f822bb500af9162', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:11.093788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 28 19:45:11.094878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 28 19:45:11.096694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 28 19:45:11.096694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 28 19:45:11.096694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:45:11.096694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:45:11.096694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 28 19:45:11.096694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:11.099357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 379/774] 10.222.0.52 () {60 vars in 1131 bytes} [Fri Oct 28 19:45:10 2022] POST /identity/v3/users => generated 160 bytes in 299 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:11.109278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.126636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.127394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.127739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.128094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.128758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.131337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:11.143532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:11.145299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 28 19:45:11.147188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:11.151545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 396/775] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:45:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:11.153098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.224630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:11.297917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3f56f-2cbf-4417-8efb-0510146bac68 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.314175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4e53d-52a7-4ed5-84ab-5d8b5a856b97 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.356389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.357695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.358018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.358470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.359552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:11.359866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.361939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.371449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 397/776] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:45:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:11.374074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.382939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.383667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.384000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.384325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.395522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.397779 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:45:11.411403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:11.413255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 380/777] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:45:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:11.415593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.450761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:11.554744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c1594-8311-4827-ba9c-c7294c45adc7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.569288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:11.578830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b296bae-9320-4a79-b962-30c3b37771f8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.606319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.607384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.607854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.608331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] PATH_INFO: `/v3/services/image` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.609350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.611900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:11.628568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:11.629978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:11.630791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 398/778] 10.222.0.52 () {56 vars in 1105 bytes} [Fri Oct 28 19:45:11 2022] GET /identity/v3/services/image => generated 86 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:11.632837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.647542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.648603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.649073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.649596 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.650705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] RBAC: Adding query filter params (type=compute) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:11.651229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.653931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.669888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 381/779] 10.222.0.52 () {56 vars in 1112 bytes} [Fri Oct 28 19:45:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:11.671559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.800206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01eb1-85d3-438f-a961-d6dc0baecc0b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.829794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:11.851264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.851896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.852185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.852532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.853361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:11.853709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.855208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.856610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14dd0a-17ad-4373-85e9-50984b9ba24e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:11.913421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 399/780] 10.222.0.52 () {56 vars in 1101 bytes} [Fri Oct 28 19:45:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:11.913421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:11.947198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:11.948620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:11.949206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:11.950365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:11.951963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] RBAC: Adding query filter params (name=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:11.952587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:11.956009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:11.960719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:11.966647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 382/781] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:11.974864 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:12.101021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ce5cd-9842-4176-86a8-73bbb83f6b10 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:12.156159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:12.157053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:12.157343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:12.157659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:12.158359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:12.159807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:12.198749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 400/782] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:45:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:45:12.202122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240bb1-8f07-4714-ab6f-e0cff1f7124e None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:12.266109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5639b96-3bc5-4399-a007-9815adf4a585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:12.266847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b96-3bc5-4399-a007-9815adf4a585 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:12.267118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b96-3bc5-4399-a007-9815adf4a585 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:12.267384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5639b96-3bc5-4399-a007-9815adf4a585 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:12.268018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639b96-3bc5-4399-a007-9815adf4a585 None admin] RBAC: Adding query filter params (type=image) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:12.268316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639b96-3bc5-4399-a007-9815adf4a585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:12.270057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5639b96-3bc5-4399-a007-9815adf4a585 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:12.276465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 383/783] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:12.282704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:12.400419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:12.423823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0758b87-ad7d-481e-bac7-ff10a0146511 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:12.490298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795b08f-0294-4755-bbd9-036bd7745838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:12.491437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b08f-0294-4755-bbd9-036bd7745838 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:12.491998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b08f-0294-4755-bbd9-036bd7745838 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:12.492462 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b08f-0294-4755-bbd9-036bd7745838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:12.493797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795b08f-0294-4755-bbd9-036bd7745838 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:12.496075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795b08f-0294-4755-bbd9-036bd7745838 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:12.529758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 401/784] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:45:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:45:12.880059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f40f9-d0ae-4fa7-923a-40debec7518f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:12.880320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f40f9-d0ae-4fa7-923a-40debec7518f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:12.880656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f40f9-d0ae-4fa7-923a-40debec7518f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:12.882407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 384/785] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:12.888947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c71b5-3012-4e1c-b6a7-a3c01b6c231a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:12.889435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c71b5-3012-4e1c-b6a7-a3c01b6c231a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:12.889597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c71b5-3012-4e1c-b6a7-a3c01b6c231a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:12.909990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-383c71b5-3012-4e1c-b6a7-a3c01b6c231a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:12.911222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-383c71b5-3012-4e1c-b6a7-a3c01b6c231a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:13.054229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 402/786] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:13.581805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f40f9-d0ae-4fa7-923a-40debec7518f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:13.613832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:13.793444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f40f9-d0ae-4fa7-923a-40debec7518f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:13.857943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07968fd5-820f-44ae-82dd-8fd73cdfe230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:13.858639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07968fd5-820f-44ae-82dd-8fd73cdfe230 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:13.858918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07968fd5-820f-44ae-82dd-8fd73cdfe230 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:13.859185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07968fd5-820f-44ae-82dd-8fd73cdfe230 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:13.860402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07968fd5-820f-44ae-82dd-8fd73cdfe230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:13.861899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07968fd5-820f-44ae-82dd-8fd73cdfe230 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:13.863819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 385/787] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:13.870652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c71b5-3012-4e1c-b6a7-a3c01b6c231a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:14.006403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:14.068635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c71b5-3012-4e1c-b6a7-a3c01b6c231a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:14.133230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a359dc-13fe-406b-a0d3-00f71c67d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:14.134267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a359dc-13fe-406b-a0d3-00f71c67d9c9 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:14.134763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a359dc-13fe-406b-a0d3-00f71c67d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:14.135277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a359dc-13fe-406b-a0d3-00f71c67d9c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:14.136430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a359dc-13fe-406b-a0d3-00f71c67d9c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:14.139221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a359dc-13fe-406b-a0d3-00f71c67d9c9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:14.197412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 403/788] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:45:13 2022] POST /identity/v3/projects => generated 311 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:45:15.463655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87097abd-1272-4662-b004-f7af204905b0 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:15.464505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87097abd-1272-4662-b004-f7af204905b0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:15.464640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87097abd-1272-4662-b004-f7af204905b0 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:15.467268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 386/789] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:15.476868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77eb5c-86d7-4722-93e7-f87773097a5e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:15.477699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77eb5c-86d7-4722-93e7-f87773097a5e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:15.477829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb77eb5c-86d7-4722-93e7-f87773097a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:15.495357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db845cc-9ee8-43af-97d0-0b6ef15ae6e8 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:15.496386 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db845cc-9ee8-43af-97d0-0b6ef15ae6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:15.497211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db845cc-9ee8-43af-97d0-0b6ef15ae6e8 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:15.501999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 387/790] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:15.505737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fb77eb5c-86d7-4722-93e7-f87773097a5e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:15.508145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fb77eb5c-86d7-4722-93e7-f87773097a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:15.510257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689093-d289-4f92-955f-cfd2818e8495 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:15.510696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689093-d289-4f92-955f-cfd2818e8495 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:15.511244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a689093-d289-4f92-955f-cfd2818e8495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:15.540104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3a689093-d289-4f92-955f-cfd2818e8495 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:15.542597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3a689093-d289-4f92-955f-cfd2818e8495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:15.641232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 404/791] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:15.651348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 388/792] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:45:15.933693 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77eb5c-86d7-4722-93e7-f87773097a5e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:16.022797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:16.113315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb77eb5c-86d7-4722-93e7-f87773097a5e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:16.139444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689093-d289-4f92-955f-cfd2818e8495 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:16.165125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:16.183887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:16.184704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.185133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.185572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.199691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:45:16.205771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:16.207678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:16.210263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 405/793] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Oct 28 19:45:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:16.216259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:16.345226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a689093-d289-4f92-955f-cfd2818e8495 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:16.361902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8dcda-8c9c-4515-8aff-980763eb073e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:16.385794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:16.407652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:16.408590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.409027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.409433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.410572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:16.412943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:16.424336 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:16.425184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.425631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.425813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.sql.core [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:45:16.425813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:45:16.425813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [parameters: {'id': 'cd1ff057dc0b4be48101a26d371fe229', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:45:16.425813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81546) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 28 19:45:16.426326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.427063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:16.427495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:16.429099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:16.445344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 406/794] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Oct 28 19:45:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:45:16.445625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 28 19:45:16.447099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application yield resource Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application next(self.gen) Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.rollback() Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.force_reraise() Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise self.value Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application session.commit() Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 28 19:45:16.448548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._prepare_impl() Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.session.flush() Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._flush(objects) Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application compat.raise_( Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application flush_context.execute() Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rec.execute(self) Oct 28 19:45:16.449665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 19:45:16.451442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result = self._query(query) Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application conn.query(q) Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application result.read() Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 28 19:45:16.454578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [parameters: {'id': 'cd1ff057dc0b4be48101a26d371fe229', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 28 19:45:16.457062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:16.459063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.462222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 389/795] 10.222.0.52 () {60 vars in 1137 bytes} [Fri Oct 28 19:45:16 2022] POST /identity/v3/domains => generated 190 bytes in 305 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:16.466710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:16.466918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:16.588792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:16.620121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec0a20-f461-49f5-a0ed-2ebb67766609 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:16.632395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4832f13-d634-4f3d-b4a1-04fa3a1b440c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:16.658323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0326ff-e4ce-4cf7-89af-080bddf9f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:16.658881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0326ff-e4ce-4cf7-89af-080bddf9f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.659162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0326ff-e4ce-4cf7-89af-080bddf9f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.659459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0326ff-e4ce-4cf7-89af-080bddf9f0ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.672534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0326ff-e4ce-4cf7-89af-080bddf9f0ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:16.674273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0326ff-e4ce-4cf7-89af-080bddf9f0ff None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-ac0326ff-e4ce-4cf7-89af-080bddf9f0ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:45:16.691646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:16.693568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:45:16.695449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:45:16.695449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:16.695449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:16.695449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 407/796] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:16.695449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b8d9-606e-43f6-82a8-13f6609c3435 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.695449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b8d9-606e-43f6-82a8-13f6609c3435 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.695449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635b8d9-606e-43f6-82a8-13f6609c3435 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.696263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 408/797] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:16.701863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:16.702661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecfea-5034-4d2c-b82d-eb8e3d57531b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.702835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.703001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecfea-5034-4d2c-b82d-eb8e3d57531b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.703172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.703354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ecfea-5034-4d2c-b82d-eb8e3d57531b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.703565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.717966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:16.719773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:16.726309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5d3ecfea-5034-4d2c-b82d-eb8e3d57531b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:16.727625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5d3ecfea-5034-4d2c-b82d-eb8e3d57531b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:45:16.741960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:16.743837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:45:16.745107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:45:16.745107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:16.745107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:16.745107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 390/798] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:16.745107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:16.759826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:16.818925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 409/799] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:45:16.820376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ecfea-5034-4d2c-b82d-eb8e3d57531b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:16.882432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f65fa9-573a-4602-a10d-40c518aecec2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:16.916042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:16.927108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:16.927907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:16.928314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:16.928898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:16.929766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:16.930418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:16.932188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:16.947204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 391/800] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:16.953333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:17.007719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ecfea-5034-4d2c-b82d-eb8e3d57531b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:17.071214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:17.072397 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.072908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.073434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.074703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:17.075225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:17.077891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:17.094885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7ce82-dfdc-4702-904b-2bd1267eed53 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:17.100425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 410/801] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:17.147422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:17.148239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.148620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.148996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.158640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:17.160497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:45:17.174882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:17.182716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:17.185042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 392/802] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Oct 28 19:45:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:17.192277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:17.228670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:17.274492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:17.346614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:17.398524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1a4601-cdf4-4de2-a55a-e29207a63fd3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:17.439730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b234977-ee97-4f45-9c2d-c5bd93a68bec None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:17.459233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:17.459957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.460369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.460764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.461699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:17.462172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:17.464238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:17.494143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 411/803] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Oct 28 19:45:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:17.503549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:17.508349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:17.509107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.509276 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.509666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.510931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:17.512472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:17.514432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 393/804] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:17.521150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:17.604157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:17.639325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86e787-7af6-4879-8a49-5d503833d980 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:17.665198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9585b4e-d5bd-4a1f-93fc-9a38dd84dee4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:17.685983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:17.686856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:17.687059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.687507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.688053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.702098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:17.703588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:17.710592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:17.711395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.711832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.712174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.712895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:17.714766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:45:17.724160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:17.726026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:45:17.727238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:45:17.727238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:17.727238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:17.727238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 412/805] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:17.735868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:17.745089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 394/806] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:45:17 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:45:17.932104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f66364-49d0-4c10-a093-34385a6d380c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:17.978465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:17.992900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:17.993660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:17.993987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:17.994424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:17.995567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:17.996009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:17.998248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:18.014011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 413/807] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:18.021760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:18.139363 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb31c6d-7c92-4edb-895e-886941b3feb5 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:18.178132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:18.178785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:18.179054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:18.179311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:18.187162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:18.188654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:45:18.209601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:18.211457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:18.212673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 395/808] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:45:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:18.217015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:18.335053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae1e3e-f1fd-4bb1-ae5d-d87fbc26bd02 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:18.376963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397adb0-e9fa-4fdb-8f12-5e2ca6f21ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:18.377707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397adb0-e9fa-4fdb-8f12-5e2ca6f21ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:18.378050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397adb0-e9fa-4fdb-8f12-5e2ca6f21ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:18.378385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397adb0-e9fa-4fdb-8f12-5e2ca6f21ec2 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:18.379163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397adb0-e9fa-4fdb-8f12-5e2ca6f21ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:18.379525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397adb0-e9fa-4fdb-8f12-5e2ca6f21ec2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:18.381088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397adb0-e9fa-4fdb-8f12-5e2ca6f21ec2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:18.395522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 414/809] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:45:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:18.402157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:18.441689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:18.530456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336b6d2-9074-4c02-a1a5-db07caf0efd4 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:18.571695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603ce0c-bf6b-4d9e-bd20-e213c2146c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:18.572526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ce0c-bf6b-4d9e-bd20-e213c2146c4a None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:18.572895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ce0c-bf6b-4d9e-bd20-e213c2146c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:18.573250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603ce0c-bf6b-4d9e-bd20-e213c2146c4a None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/8e5bd5f8509b414c8699ec51117745cb/roles/bb69435d22924835a809f5eb32133dec` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:18.575752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603ce0c-bf6b-4d9e-bd20-e213c2146c4a None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=8e5bd5f8509b414c8699ec51117745cb, role_id=bb69435d22924835a809f5eb32133dec)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:18.577209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603ce0c-bf6b-4d9e-bd20-e213c2146c4a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:18.594668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 396/810] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:45:18 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/8e5bd5f8509b414c8699ec51117745cb/roles/bb69435d22924835a809f5eb32133dec => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:45:20.203871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0c3c-136f-4b2b-a3ae-ee5ceeea0bb4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.204699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0c3c-136f-4b2b-a3ae-ee5ceeea0bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.204699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0c3c-136f-4b2b-a3ae-ee5ceeea0bb4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.205845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 415/811] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:20.215335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075ead-ec56-424e-891f-7f7d5677443c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.215919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075ead-ec56-424e-891f-7f7d5677443c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.216286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca075ead-ec56-424e-891f-7f7d5677443c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.254337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ca075ead-ec56-424e-891f-7f7d5677443c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:20.255588 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ca075ead-ec56-424e-891f-7f7d5677443c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:20.337813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 397/812] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:20.603794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c0c3c-136f-4b2b-a3ae-ee5ceeea0bb4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:20.690029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:20.776933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c0c3c-136f-4b2b-a3ae-ee5ceeea0bb4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:20.825996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d074bc4-96ad-47eb-8cd4-f3f5e759f53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:20.827103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074bc4-96ad-47eb-8cd4-f3f5e759f53a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.827588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074bc4-96ad-47eb-8cd4-f3f5e759f53a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.828078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d074bc4-96ad-47eb-8cd4-f3f5e759f53a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.849725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d074bc4-96ad-47eb-8cd4-f3f5e759f53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3d074bc4-96ad-47eb-8cd4-f3f5e759f53a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:45:20.859616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:20.861554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:20.862676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 416/813] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:20.871537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075ead-ec56-424e-891f-7f7d5677443c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:20.900096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:20.967079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19afa-e9f0-4741-8b61-7da0b468cd19 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.967529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19afa-e9f0-4741-8b61-7da0b468cd19 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.967984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af19afa-e9f0-4741-8b61-7da0b468cd19 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.970386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 417/814] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:20.979059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032928dd-2a85-4e3a-8126-0e8478dd11aa None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:20.979529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032928dd-2a85-4e3a-8126-0e8478dd11aa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:20.979993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032928dd-2a85-4e3a-8126-0e8478dd11aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:20.994673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca075ead-ec56-424e-891f-7f7d5677443c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:21.009489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-032928dd-2a85-4e3a-8126-0e8478dd11aa None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:21.011466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-032928dd-2a85-4e3a-8126-0e8478dd11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:21.033673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:21.034301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:21.034575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:21.034839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:21.035539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:21.035831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:21.037334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:21.048718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 398/815] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:21.055762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:21.099379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 418/816] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:21.173511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:21.196907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e8d79-085d-4232-9127-2998dfe633a0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:21.249158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:21.250285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:21.250285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:21.250623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] PATH_INFO: `/v3/users/78e50dc1828b4d8a82ee73bb08995c6e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:21.277442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] RBAC: Authorizing `identity:get_user(user_id=78e50dc1828b4d8a82ee73bb08995c6e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:21.280235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:21.288562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 399/817] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:21 2022] GET /identity/v3/users/78e50dc1828b4d8a82ee73bb08995c6e => generated 285 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:21.290772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032928dd-2a85-4e3a-8126-0e8478dd11aa None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:21.347898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:21.431008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:21.452041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032928dd-2a85-4e3a-8126-0e8478dd11aa None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:21.495922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:21.496621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:21.497411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:21.497786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] PATH_INFO: `/v3/projects/8284299cc2b145ae94d9c4f740205216` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:21.499519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] RBAC: Authorizing `identity:get_project(project_id=8284299cc2b145ae94d9c4f740205216)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:21.501310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:21.503169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 419/818] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:45:21 2022] GET /identity/v3/projects/8284299cc2b145ae94d9c4f740205216 => generated 311 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:21.509895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:21.577690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d5911-5059-4c3b-830e-3f7f28547553 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:21.619900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:21.620682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:21.621200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:21.621609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:21.635505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:45:21.640397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:21.642250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:21.643841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 400/819] 10.222.0.52 () {56 vars in 1120 bytes} [Fri Oct 28 19:45:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:21.651563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:21.655751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:21.677305 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737790a-3ccc-4a26-8311-04c24896384e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:21.680187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:21.728973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:21.729983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:21.730395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:21.730870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] PATH_INFO: `/v3/projects/8284299cc2b145ae94d9c4f740205216/users/78e50dc1828b4d8a82ee73bb08995c6e/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:21.733339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8284299cc2b145ae94d9c4f740205216, user_id=78e50dc1828b4d8a82ee73bb08995c6e, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:21.735616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:21.760077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 420/820] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:45:21 2022] PUT /identity/v3/projects/8284299cc2b145ae94d9c4f740205216/users/78e50dc1828b4d8a82ee73bb08995c6e/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:45:21.790744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba52cf3-6bba-4cae-8e0d-be34b78bb4f1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:21.837553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:21.838180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:21.838453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:21.838723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:21.839440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:21.839820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:21.841304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:21.852869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 401/821] 10.222.0.52 () {56 vars in 1115 bytes} [Fri Oct 28 19:45:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:21.859476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:21.993201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91561f6d-ab8f-49b8-bbbe-b9d8c96c41a9 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:22.037577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:22.038262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:22.040123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:22.040400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:22.053570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:22.055322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:45:22.071766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:22.073599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:45:22.075319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:45:22.075319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:22.075319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:22.075319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 421/822] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:22.079545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:22.159045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:22.207580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06d742-e28d-47e3-89a2-4739714460fa None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:22.252899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:22.254043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:22.254043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:22.254327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:22.254871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:22.255170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:22.256581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:22.271598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 402/823] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:22.278681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:22.308439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:22.412702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267747-d75e-46e4-aea5-719d960917fc None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:22.475247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:22.476285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:22.476765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:22.477218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:22.488276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:22.489978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:45:22.504081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:22.505127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:22.506192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 422/824] 10.222.0.52 () {56 vars in 1093 bytes} [Fri Oct 28 19:45:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:22.512128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:22.630503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76f198-49ce-43fc-93bb-c55d59c0d143 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:22.658239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:22.671311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:22.672074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:22.672343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:22.672620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:22.673494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:22.673790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:22.675394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:22.696089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 403/825] 10.222.0.52 () {56 vars in 1133 bytes} [Fri Oct 28 19:45:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:22.702330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:22.792056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:22.819471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956a197-531f-4546-bcf0-d25efb5c6b76 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:22.861031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:22.861703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:22.861981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:22.862250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:22.944541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:22.946213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:23.066700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:23.114213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 423/826] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:45:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:45:23.116080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:23.256218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9e270-40d9-41ba-b796-7c10b4c6ba94 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:23.297682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:23.298466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.298846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.299203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.312001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:23.313650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:45:23.331553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:23.338604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:45:23.340652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:45:23.340652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:45:23.340652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:23.340652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 404/827] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:23.341145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:23.476398 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e46976-65ea-406c-9a0a-2c0b2279a926 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:23.519796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:23.520537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.520897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.521263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.522056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:23.522460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:23.523996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:23.538277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 424/828] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:23.545539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:23.609828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:23.740449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63317-050a-4533-9a24-358cf2a3ab57 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:23.804992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:23.806095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:23.806567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:23.807036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:23.820171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:23.822950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:45:23.844917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:23.846106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:45:23.847110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:23.847620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 405/829] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:23.854089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:23.899753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:23.984882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467024fa-a36f-4666-bfd4-fba216e5741f None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:24.025992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f7021-86b7-4b75-a7f1-884196230229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:24.026626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7021-86b7-4b75-a7f1-884196230229 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:24.026905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7021-86b7-4b75-a7f1-884196230229 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:24.027343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f7021-86b7-4b75-a7f1-884196230229 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:24.027982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f7021-86b7-4b75-a7f1-884196230229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:24.028286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f7021-86b7-4b75-a7f1-884196230229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:24.029808 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f7021-86b7-4b75-a7f1-884196230229 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:24.044688 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 425/830] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:24.051726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:24.167869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:24.176862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f12d2e-bfb6-4758-9b69-7aea991442cd None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:24.220326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72096886-8aad-45b6-bc93-e34019d3225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:24.221058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096886-8aad-45b6-bc93-e34019d3225a None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:24.221421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096886-8aad-45b6-bc93-e34019d3225a None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:24.221798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72096886-8aad-45b6-bc93-e34019d3225a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:24.222654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096886-8aad-45b6-bc93-e34019d3225a None admin] RBAC: Adding query filter params (role.id=bb69435d22924835a809f5eb32133dec, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=8e5bd5f8509b414c8699ec51117745cb) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:24.223023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096886-8aad-45b6-bc93-e34019d3225a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:24.224645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72096886-8aad-45b6-bc93-e34019d3225a None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:24.232463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 406/831] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:45:24 2022] GET /identity/v3/role_assignments?user.id=8e5bd5f8509b414c8699ec51117745cb&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=bb69435d22924835a809f5eb32133dec => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:24.348762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00d127-1ced-4220-b446-1639f018168a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:24.349422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00d127-1ced-4220-b446-1639f018168a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:24.349716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00d127-1ced-4220-b446-1639f018168a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:24.352452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 426/832] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:24.359157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3927b3-f9b9-451c-8fa7-0bf88e6f33e1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:24.359991 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3927b3-f9b9-451c-8fa7-0bf88e6f33e1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:24.359991 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3927b3-f9b9-451c-8fa7-0bf88e6f33e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:24.381367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9d3927b3-f9b9-451c-8fa7-0bf88e6f33e1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:24.382942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9d3927b3-f9b9-451c-8fa7-0bf88e6f33e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:24.473022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 407/833] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:45:24.744995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00d127-1ced-4220-b446-1639f018168a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:24.876054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:24.886727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00d127-1ced-4220-b446-1639f018168a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:24.938747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:24.939530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:24.939955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:24.940318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:24.957165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:45:24.963878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:24.966052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:24.967646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 427/834] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:24.974470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3927b3-f9b9-451c-8fa7-0bf88e6f33e1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:25.110016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:25.130401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3927b3-f9b9-451c-8fa7-0bf88e6f33e1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:25.175372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:25.176011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:25.176285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:25.176562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:25.177263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:25.177598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:25.179019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:25.189513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 408/835] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:25.196423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:25.341276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd04190-4d14-434b-9250-355d9bc7f154 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:25.382388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:25.383106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:25.383226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:25.383480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] PATH_INFO: `/v3/users/78e50dc1828b4d8a82ee73bb08995c6e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:25.384799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] RBAC: Authorizing `identity:get_user(user_id=78e50dc1828b4d8a82ee73bb08995c6e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:25.386435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:25.388126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 428/836] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:25 2022] GET /identity/v3/users/78e50dc1828b4d8a82ee73bb08995c6e => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:25.394995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:25.515659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895ac1-3272-476a-84d0-8f004d94cd29 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:25.556907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:25.557559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:25.557834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:25.558103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:25.580209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:25.641355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:25.642818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:25.762158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 409/837] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:45:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 28 19:45:25.768630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:25.808035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:25.943936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec1f5-596f-472b-a391-033c69b826db None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:26.001477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6437be-c96d-4fd9-91fd-02a4cfd98f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:26.002185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6437be-c96d-4fd9-91fd-02a4cfd98f54 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.002471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6437be-c96d-4fd9-91fd-02a4cfd98f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.002824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6437be-c96d-4fd9-91fd-02a4cfd98f54 None admin] PATH_INFO: `/v3/projects/8284299cc2b145ae94d9c4f740205216` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.004145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6437be-c96d-4fd9-91fd-02a4cfd98f54 None admin] RBAC: Authorizing `identity:get_project(project_id=8284299cc2b145ae94d9c4f740205216)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:26.005755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6437be-c96d-4fd9-91fd-02a4cfd98f54 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:26.007510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 429/838] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:45:25 2022] GET /identity/v3/projects/8284299cc2b145ae94d9c4f740205216 => generated 311 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:26.017612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:26.081285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:26.138906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259e99b-10ae-40d9-9b8e-4bba0d40980f None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:26.179482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a9fe1-bed5-4728-8943-2d0205a0e323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:26.180143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a9fe1-bed5-4728-8943-2d0205a0e323 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:26.180467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a9fe1-bed5-4728-8943-2d0205a0e323 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:26.180752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a9fe1-bed5-4728-8943-2d0205a0e323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:26.181700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a9fe1-bed5-4728-8943-2d0205a0e323 None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=8284299cc2b145ae94d9c4f740205216, user.id=78e50dc1828b4d8a82ee73bb08995c6e) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:26.182084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a9fe1-bed5-4728-8943-2d0205a0e323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:26.183723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a9fe1-bed5-4728-8943-2d0205a0e323 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:26.190714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 410/839] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:45:26 2022] GET /identity/v3/role_assignments?user.id=78e50dc1828b4d8a82ee73bb08995c6e&scope.project.id=8284299cc2b145ae94d9c4f740205216&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:28.457514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb21e6-68ae-4a3e-b890-9e1068c5a5f4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:28.458211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb21e6-68ae-4a3e-b890-9e1068c5a5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:28.458211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb21e6-68ae-4a3e-b890-9e1068c5a5f4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:28.459560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 430/840] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:28.465777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d686e1-53f9-4622-aaeb-a1ff364fd870 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:28.466623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d686e1-53f9-4622-aaeb-a1ff364fd870 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:28.466623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d686e1-53f9-4622-aaeb-a1ff364fd870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:28.487193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-94d686e1-53f9-4622-aaeb-a1ff364fd870 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:28.488578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-94d686e1-53f9-4622-aaeb-a1ff364fd870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:28.565167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 411/841] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:28.832916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb21e6-68ae-4a3e-b890-9e1068c5a5f4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:29.005932 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:29.018526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb21e6-68ae-4a3e-b890-9e1068c5a5f4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:29.060473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c368a-0b84-4931-bd67-afbd5f98581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:29.061115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c368a-0b84-4931-bd67-afbd5f98581b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:29.061438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c368a-0b84-4931-bd67-afbd5f98581b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:29.061711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c368a-0b84-4931-bd67-afbd5f98581b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:29.062947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c368a-0b84-4931-bd67-afbd5f98581b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:29.064451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c368a-0b84-4931-bd67-afbd5f98581b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:29.066208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 431/842] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:29.072592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d686e1-53f9-4622-aaeb-a1ff364fd870 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:29.125058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:29.188741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d686e1-53f9-4622-aaeb-a1ff364fd870 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:29.229084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a0950-f8c0-41ed-8027-dc1092a82178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:29.229792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0950-f8c0-41ed-8027-dc1092a82178 None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:29.230055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0950-f8c0-41ed-8027-dc1092a82178 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:29.230327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a0950-f8c0-41ed-8027-dc1092a82178 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:29.231010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a0950-f8c0-41ed-8027-dc1092a82178 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:29.232496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a0950-f8c0-41ed-8027-dc1092a82178 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:29.256999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 412/843] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:45:29 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:45:31.609966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025568f-f1b2-4e2c-9dcd-a49ff2931921 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:31.610584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025568f-f1b2-4e2c-9dcd-a49ff2931921 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:31.610584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025568f-f1b2-4e2c-9dcd-a49ff2931921 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:31.612075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 432/844] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:31.620682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991f48-ac59-421f-9b90-c0ca46ceaad6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:31.621198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991f48-ac59-421f-9b90-c0ca46ceaad6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:31.621321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991f48-ac59-421f-9b90-c0ca46ceaad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:31.641126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c4991f48-ac59-421f-9b90-c0ca46ceaad6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:31.642399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c4991f48-ac59-421f-9b90-c0ca46ceaad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:31.723179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 413/845] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:32.095467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025568f-f1b2-4e2c-9dcd-a49ff2931921 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:32.218010 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025568f-f1b2-4e2c-9dcd-a49ff2931921 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:32.260353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:32.261018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:32.261319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:32.261629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] PATH_INFO: `/v3/roles/3b63b6b8ba3a43158d1be9fe4d2322d5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:32.263195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] RBAC: Authorizing `identity:get_role(role_id=3b63b6b8ba3a43158d1be9fe4d2322d5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:32.264619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:32.266059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 433/846] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:32 2022] GET /identity/v3/roles/3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:32.272883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991f48-ac59-421f-9b90-c0ca46ceaad6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:32.308848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:32.400016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991f48-ac59-421f-9b90-c0ca46ceaad6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:32.439755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:32.440407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:32.440658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:32.440952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] PATH_INFO: `/v3/users/6509adf9ac554d3480c4ac8c3f598979` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:32.457371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] RBAC: Authorizing `identity:get_user(user_id=6509adf9ac554d3480c4ac8c3f598979)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:32.458873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:32.460617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 414/847] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:32 2022] GET /identity/v3/users/6509adf9ac554d3480c4ac8c3f598979 => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:32.467624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:32.519070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:32.610629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6c3c2-769f-4c7b-8a67-d5e730cf8ec2 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:32.649564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5d3a-a1c2-44c6-bb45-89d5706826f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:32.650283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5d3a-a1c2-44c6-bb45-89d5706826f7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:32.650503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5d3a-a1c2-44c6-bb45-89d5706826f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:32.650795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5d3a-a1c2-44c6-bb45-89d5706826f7 None admin] PATH_INFO: `/v3/projects/8284299cc2b145ae94d9c4f740205216` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:32.651980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e5d3a-a1c2-44c6-bb45-89d5706826f7 None admin] RBAC: Authorizing `identity:get_project(project_id=8284299cc2b145ae94d9c4f740205216)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:32.653460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e5d3a-a1c2-44c6-bb45-89d5706826f7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:32.655157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 434/848] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:45:32 2022] GET /identity/v3/projects/8284299cc2b145ae94d9c4f740205216 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:32.661731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:32.761906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:32.776222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66db1f6-c6b3-438a-86c7-4bd6ff703d9c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:32.815690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45598b-f938-4db5-a929-9e5f073eb92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:32.816378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45598b-f938-4db5-a929-9e5f073eb92d None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:32.816649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45598b-f938-4db5-a929-9e5f073eb92d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:32.816928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45598b-f938-4db5-a929-9e5f073eb92d None admin] PATH_INFO: `/v3/projects/8284299cc2b145ae94d9c4f740205216/users/6509adf9ac554d3480c4ac8c3f598979/roles/3b63b6b8ba3a43158d1be9fe4d2322d5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:32.819519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45598b-f938-4db5-a929-9e5f073eb92d None admin] RBAC: Authorizing `identity:create_grant(project_id=8284299cc2b145ae94d9c4f740205216, user_id=6509adf9ac554d3480c4ac8c3f598979, role_id=3b63b6b8ba3a43158d1be9fe4d2322d5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:32.821005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c45598b-f938-4db5-a929-9e5f073eb92d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:32.836551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 415/849] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:45:32 2022] PUT /identity/v3/projects/8284299cc2b145ae94d9c4f740205216/users/6509adf9ac554d3480c4ac8c3f598979/roles/3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:45:35.107772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b7c5d-a07b-4352-b30e-45c926a97f22 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:35.108321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b7c5d-a07b-4352-b30e-45c926a97f22 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:35.108321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b7c5d-a07b-4352-b30e-45c926a97f22 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:35.109694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 435/850] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:35.116204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3197f-91ef-4cb7-b71c-05b55b049353 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:35.117019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3197f-91ef-4cb7-b71c-05b55b049353 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:35.117019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3197f-91ef-4cb7-b71c-05b55b049353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:35.137225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a0f3197f-91ef-4cb7-b71c-05b55b049353 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:35.138487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a0f3197f-91ef-4cb7-b71c-05b55b049353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:35.219254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 416/851] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:35.488516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b7c5d-a07b-4352-b30e-45c926a97f22 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:35.603103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:35.615668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b7c5d-a07b-4352-b30e-45c926a97f22 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:35.680058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:35.680766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:35.681085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:35.681420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] PATH_INFO: `/v3/roles/3b63b6b8ba3a43158d1be9fe4d2322d5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:35.682961 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] RBAC: Authorizing `identity:get_role(role_id=3b63b6b8ba3a43158d1be9fe4d2322d5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:35.684421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:35.685965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 436/852] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:35 2022] GET /identity/v3/roles/3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 223 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:35.692586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3197f-91ef-4cb7-b71c-05b55b049353 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:35.842246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:35.871445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3197f-91ef-4cb7-b71c-05b55b049353 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:35.913269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451f403-265c-4793-9939-20222ee459ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:35.914052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451f403-265c-4793-9939-20222ee459ba None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:35.914375 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451f403-265c-4793-9939-20222ee459ba None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:35.914699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451f403-265c-4793-9939-20222ee459ba None admin] PATH_INFO: `/v3/users/6509adf9ac554d3480c4ac8c3f598979` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:35.916028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451f403-265c-4793-9939-20222ee459ba None admin] RBAC: Authorizing `identity:get_user(user_id=6509adf9ac554d3480c4ac8c3f598979)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:35.917684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451f403-265c-4793-9939-20222ee459ba None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:35.919496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 417/853] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:35 2022] GET /identity/v3/users/6509adf9ac554d3480c4ac8c3f598979 => generated 286 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:35.926231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:36.051661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1af3f-6b82-437b-8ce0-fd588bf9d76b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:36.094362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:36.094901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:36.095183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:36.095455 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:36.139105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:36.186340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:36.188025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:36.306528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 437/854] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:45:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:45:36.313709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451f403-265c-4793-9939-20222ee459ba None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:36.504089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451f403-265c-4793-9939-20222ee459ba None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:36.546392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f3fa9-2feb-4c48-b064-9aee9cdc980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:36.547023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3fa9-2feb-4c48-b064-9aee9cdc980e None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:36.547270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3fa9-2feb-4c48-b064-9aee9cdc980e None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:36.547543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f3fa9-2feb-4c48-b064-9aee9cdc980e None admin] PATH_INFO: `/v3/projects/8284299cc2b145ae94d9c4f740205216` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:36.548812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f3fa9-2feb-4c48-b064-9aee9cdc980e None admin] RBAC: Authorizing `identity:get_project(project_id=8284299cc2b145ae94d9c4f740205216)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:36.550404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f3fa9-2feb-4c48-b064-9aee9cdc980e None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:36.552162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 418/855] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:45:36 2022] GET /identity/v3/projects/8284299cc2b145ae94d9c4f740205216 => generated 311 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:36.559092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:36.632678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:36.678431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bcbcb0-b77e-47df-bdc3-d878789b8c48 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:36.719861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd24143-12d0-4e64-9363-bb87b41176d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:36.720497 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24143-12d0-4e64-9363-bb87b41176d3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:36.720775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24143-12d0-4e64-9363-bb87b41176d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:36.721047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd24143-12d0-4e64-9363-bb87b41176d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:36.721851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24143-12d0-4e64-9363-bb87b41176d3 None admin] RBAC: Adding query filter params (role.id=3b63b6b8ba3a43158d1be9fe4d2322d5, scope.project.id=8284299cc2b145ae94d9c4f740205216, user.id=6509adf9ac554d3480c4ac8c3f598979) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:36.722157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24143-12d0-4e64-9363-bb87b41176d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:36.723670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd24143-12d0-4e64-9363-bb87b41176d3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:36.731076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 438/856] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:45:36 2022] GET /identity/v3/role_assignments?user.id=6509adf9ac554d3480c4ac8c3f598979&scope.project.id=8284299cc2b145ae94d9c4f740205216&role.id=3b63b6b8ba3a43158d1be9fe4d2322d5 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:39.068090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac111380-a823-43b5-92a9-942df4569d00 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:39.068775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac111380-a823-43b5-92a9-942df4569d00 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:39.068775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac111380-a823-43b5-92a9-942df4569d00 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:39.070158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 419/857] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:39.076346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc430-1b4a-47f8-8573-47a4004713f9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:39.077003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc430-1b4a-47f8-8573-47a4004713f9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:39.077003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcc430-1b4a-47f8-8573-47a4004713f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:39.098416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-20bcc430-1b4a-47f8-8573-47a4004713f9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:39.099612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-20bcc430-1b4a-47f8-8573-47a4004713f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:39.179282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 439/858] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:39.456027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac111380-a823-43b5-92a9-942df4569d00 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:39.474787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:39.580512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac111380-a823-43b5-92a9-942df4569d00 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:39.620195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d63a71-198e-44b0-bc9a-e8793f6ac7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:39.620912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63a71-198e-44b0-bc9a-e8793f6ac7c9 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:39.621229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63a71-198e-44b0-bc9a-e8793f6ac7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:39.621620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d63a71-198e-44b0-bc9a-e8793f6ac7c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:39.622865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d63a71-198e-44b0-bc9a-e8793f6ac7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:39.624352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d63a71-198e-44b0-bc9a-e8793f6ac7c9 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:39.626056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 420/859] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:39.632496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc430-1b4a-47f8-8573-47a4004713f9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:39.708142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:39.760402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcc430-1b4a-47f8-8573-47a4004713f9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:39.799302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890cb2ed-f8e6-46e2-a9fd-962aff343e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:39.800040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb2ed-f8e6-46e2-a9fd-962aff343e47 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:39.800311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb2ed-f8e6-46e2-a9fd-962aff343e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:39.800575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890cb2ed-f8e6-46e2-a9fd-962aff343e47 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:39.801276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cb2ed-f8e6-46e2-a9fd-962aff343e47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:39.802904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890cb2ed-f8e6-46e2-a9fd-962aff343e47 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:39.843440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 440/860] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:45:39 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:45:42.126949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330edb-b035-4d50-9eb0-891fe2979f87 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:42.127554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330edb-b035-4d50-9eb0-891fe2979f87 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:42.127554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a330edb-b035-4d50-9eb0-891fe2979f87 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:42.128776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 421/861] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:42.135343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3e71-394c-4432-b32b-a896bb8302ed None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:42.136011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3e71-394c-4432-b32b-a896bb8302ed None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:42.136011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3e71-394c-4432-b32b-a896bb8302ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:42.156580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2aeb3e71-394c-4432-b32b-a896bb8302ed None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:42.157864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2aeb3e71-394c-4432-b32b-a896bb8302ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:42.249370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 441/862] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:42.776320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330edb-b035-4d50-9eb0-891fe2979f87 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:42.938362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:42.976348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a330edb-b035-4d50-9eb0-891fe2979f87 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:43.044156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439a189-540e-49ca-be9a-02be5182d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:43.045128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a189-540e-49ca-be9a-02be5182d4de None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.045644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a189-540e-49ca-be9a-02be5182d4de None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.046121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439a189-540e-49ca-be9a-02be5182d4de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.048327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a189-540e-49ca-be9a-02be5182d4de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:43.051035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439a189-540e-49ca-be9a-02be5182d4de None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:43.054067 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 422/863] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:45:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:43.060635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3e71-394c-4432-b32b-a896bb8302ed None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:43.112489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:43.184540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb3e71-394c-4432-b32b-a896bb8302ed None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:43.225532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7dc586-f812-4112-99cf-94f5d315a733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:43.226194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dc586-f812-4112-99cf-94f5d315a733 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:43.226475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dc586-f812-4112-99cf-94f5d315a733 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:43.226744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7dc586-f812-4112-99cf-94f5d315a733 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:43.227417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dc586-f812-4112-99cf-94f5d315a733 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:43.229027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7dc586-f812-4112-99cf-94f5d315a733 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:43.254547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 442/864] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:45:43 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:45:45.647283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549898b9-a33c-470d-96f3-df83f9116cca None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:45.648165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549898b9-a33c-470d-96f3-df83f9116cca None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:45.648165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549898b9-a33c-470d-96f3-df83f9116cca None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:45.649974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 423/865] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:45.656569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e153-1588-47ca-9530-39132a78bc16 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:45.657173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e153-1588-47ca-9530-39132a78bc16 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:45.657173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9e153-1588-47ca-9530-39132a78bc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:45.678115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-90c9e153-1588-47ca-9530-39132a78bc16 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:45.679356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-90c9e153-1588-47ca-9530-39132a78bc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:45.760853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 443/866] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:46.032454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549898b9-a33c-470d-96f3-df83f9116cca None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:46.208371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549898b9-a33c-470d-96f3-df83f9116cca None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:46.254966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:46.255797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:46.256147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:46.256503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:46.275464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:45:46.280893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:46.282697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:45:46.284155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 424/867] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:45:46.290137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9e153-1588-47ca-9530-39132a78bc16 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:46.321941 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:46.412104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9e153-1588-47ca-9530-39132a78bc16 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:46.452865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:46.453535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:46.453818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:46.454094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:46.454788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:46.455092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:46.456540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:46.467340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 444/868] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:45:46.474538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:46.498786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:46.629147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c607c-1782-49f2-b54e-9d5e3edd47d7 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:46.671992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:46.673172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:46.673779 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:46.674325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] PATH_INFO: `/v3/users/82155c7a760d4c84899a35b02e8c8d55` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:46.700092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] RBAC: Authorizing `identity:get_user(user_id=82155c7a760d4c84899a35b02e8c8d55)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:46.702979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:46.706216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 425/869] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:46 2022] GET /identity/v3/users/82155c7a760d4c84899a35b02e8c8d55 => generated 286 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:46.712403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:46.817221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:46.832549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b31a89-8961-4635-b0ab-de7897c4ef43 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:46.874020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadb2aa-0c12-4266-9d51-14df0638b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:46.874678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadb2aa-0c12-4266-9d51-14df0638b0fb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:46.874956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadb2aa-0c12-4266-9d51-14df0638b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:46.875229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadb2aa-0c12-4266-9d51-14df0638b0fb None admin] PATH_INFO: `/v3/projects/5a51da31a9584294bacc3fba69c774cc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:46.876448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadb2aa-0c12-4266-9d51-14df0638b0fb None admin] RBAC: Authorizing `identity:get_project(project_id=5a51da31a9584294bacc3fba69c774cc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:46.878241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadb2aa-0c12-4266-9d51-14df0638b0fb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:46.880168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 445/870] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:45:46 2022] GET /identity/v3/projects/5a51da31a9584294bacc3fba69c774cc => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:46.887074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:46.963298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:47.002191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b446eb-d4cc-4adb-9354-474943246aef None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:47.041558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b02751-fbf0-4931-b418-629187bec34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:47.042244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02751-fbf0-4931-b418-629187bec34b None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:47.042519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02751-fbf0-4931-b418-629187bec34b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:47.042776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b02751-fbf0-4931-b418-629187bec34b None admin] PATH_INFO: `/v3/projects/5a51da31a9584294bacc3fba69c774cc/users/82155c7a760d4c84899a35b02e8c8d55/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:47.044791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b02751-fbf0-4931-b418-629187bec34b None admin] RBAC: Authorizing `identity:create_grant(project_id=5a51da31a9584294bacc3fba69c774cc, user_id=82155c7a760d4c84899a35b02e8c8d55, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:47.046306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b02751-fbf0-4931-b418-629187bec34b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:47.061612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 426/871] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:45:46 2022] PUT /identity/v3/projects/5a51da31a9584294bacc3fba69c774cc/users/82155c7a760d4c84899a35b02e8c8d55/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:45:49.273659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb6496-ccce-49d8-b21c-dcde86671469 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:49.274229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb6496-ccce-49d8-b21c-dcde86671469 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:49.274229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb6496-ccce-49d8-b21c-dcde86671469 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:49.275739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 446/872] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:45:49.285405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa625-a847-4992-8111-18c517f2d6eb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:49.285944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa625-a847-4992-8111-18c517f2d6eb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:49.286403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fa625-a847-4992-8111-18c517f2d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:49.316708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0d8fa625-a847-4992-8111-18c517f2d6eb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:49.318819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0d8fa625-a847-4992-8111-18c517f2d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:49.437797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 427/873] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:49.710163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb6496-ccce-49d8-b21c-dcde86671469 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:49.838716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb6496-ccce-49d8-b21c-dcde86671469 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:49.879757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:49.880405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:49.880683 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:49.880959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:49.894359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:45:49.899476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:45:49.901265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:45:49.903100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 447/874] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:45:49.908869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fa625-a847-4992-8111-18c517f2d6eb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:49.979730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:50.032357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fa625-a847-4992-8111-18c517f2d6eb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:50.073458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:50.074217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:50.074584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:50.074952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:50.075746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:50.076142 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:50.077760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:50.088390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 428/875] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:50.098536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:50.130700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:50.239744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc9d4-6704-4d52-9422-b0eee4e571c8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:50.281400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:50.282102 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:50.282353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:50.282622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] PATH_INFO: `/v3/users/82155c7a760d4c84899a35b02e8c8d55` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:50.283890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] RBAC: Authorizing `identity:get_user(user_id=82155c7a760d4c84899a35b02e8c8d55)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:50.285424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:50.287117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 448/876] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:45:50 2022] GET /identity/v3/users/82155c7a760d4c84899a35b02e8c8d55 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:50.294057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:50.413202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9e6c5-c53f-4493-b35e-b3590c358fe8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:50.437051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:50.454836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:50.455462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:50.455732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:50.455994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:50.539543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:50.541060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:50.659504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 429/877] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:45:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:45:50.666023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:50.765047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:50.783937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84054a-1e9f-4310-90d0-5dc0eace0f09 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:50.822864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5ee15-3bf5-46e4-a5df-bf0a76eb56bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:50.823428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ee15-3bf5-46e4-a5df-bf0a76eb56bd None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:50.823711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ee15-3bf5-46e4-a5df-bf0a76eb56bd None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:50.823987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5ee15-3bf5-46e4-a5df-bf0a76eb56bd None admin] PATH_INFO: `/v3/projects/5a51da31a9584294bacc3fba69c774cc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:50.825252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5ee15-3bf5-46e4-a5df-bf0a76eb56bd None admin] RBAC: Authorizing `identity:get_project(project_id=5a51da31a9584294bacc3fba69c774cc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:50.826793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5ee15-3bf5-46e4-a5df-bf0a76eb56bd None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:50.828534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 449/878] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:45:50 2022] GET /identity/v3/projects/5a51da31a9584294bacc3fba69c774cc => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:50.838962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:50.878400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:50.974317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d210a8-37f7-4329-a535-d94d1838a0ab None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:51.014177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b71131-b4dd-408c-9228-07911a630471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:51.014804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71131-b4dd-408c-9228-07911a630471 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:51.015080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71131-b4dd-408c-9228-07911a630471 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:51.015347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b71131-b4dd-408c-9228-07911a630471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:51.016091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71131-b4dd-408c-9228-07911a630471 None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=5a51da31a9584294bacc3fba69c774cc, user.id=82155c7a760d4c84899a35b02e8c8d55) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:45:51.016389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71131-b4dd-408c-9228-07911a630471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:51.018268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b71131-b4dd-408c-9228-07911a630471 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:51.025443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 430/879] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:45:50 2022] GET /identity/v3/role_assignments?user.id=82155c7a760d4c84899a35b02e8c8d55&scope.project.id=5a51da31a9584294bacc3fba69c774cc&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:53.292868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742622f1-c8b3-41cd-b982-1655a635f7d4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:53.293513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742622f1-c8b3-41cd-b982-1655a635f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:53.293513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742622f1-c8b3-41cd-b982-1655a635f7d4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:53.295074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 450/880] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:53.301428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af03dce-94b7-488e-bcdb-c2fd0778e73b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:53.302057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af03dce-94b7-488e-bcdb-c2fd0778e73b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:53.302057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af03dce-94b7-488e-bcdb-c2fd0778e73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:53.322609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3af03dce-94b7-488e-bcdb-c2fd0778e73b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:53.323901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3af03dce-94b7-488e-bcdb-c2fd0778e73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:53.407710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 431/881] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:53.680186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742622f1-c8b3-41cd-b982-1655a635f7d4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:53.796464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742622f1-c8b3-41cd-b982-1655a635f7d4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:53.837393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3232025-35b3-42b3-a37c-3cfa73fad065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:53.838041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232025-35b3-42b3-a37c-3cfa73fad065 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:53.838313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232025-35b3-42b3-a37c-3cfa73fad065 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:53.838592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3232025-35b3-42b3-a37c-3cfa73fad065 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:53.839291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232025-35b3-42b3-a37c-3cfa73fad065 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:53.840733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3232025-35b3-42b3-a37c-3cfa73fad065 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:53.859520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 451/882] 10.222.0.52 () {60 vars in 1138 bytes} [Fri Oct 28 19:45:53 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:45:56.153265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef13f-ed35-43b3-a25c-2014796a98d4 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:56.153880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef13f-ed35-43b3-a25c-2014796a98d4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:56.153880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ef13f-ed35-43b3-a25c-2014796a98d4 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:56.155189 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 432/883] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:56.161849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e025a-53a7-4db8-b170-c1d2d8779a38 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:56.162452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e025a-53a7-4db8-b170-c1d2d8779a38 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:56.162452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e025a-53a7-4db8-b170-c1d2d8779a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:56.182740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1f9e025a-53a7-4db8-b170-c1d2d8779a38 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:56.183967 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1f9e025a-53a7-4db8-b170-c1d2d8779a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:56.193136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:56.266702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 452/884] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:56.544942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef13f-ed35-43b3-a25c-2014796a98d4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:56.562698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:56.673091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ef13f-ed35-43b3-a25c-2014796a98d4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:56.713233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6583d25-8b11-4ff4-aa83-42b44e2680f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:56.713980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583d25-8b11-4ff4-aa83-42b44e2680f3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:56.714294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583d25-8b11-4ff4-aa83-42b44e2680f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:56.714603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6583d25-8b11-4ff4-aa83-42b44e2680f3 None admin] PATH_INFO: `/v3/domains/457ae8301d9e40dc97423d204e7ca71a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:56.728955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6583d25-8b11-4ff4-aa83-42b44e2680f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=457ae8301d9e40dc97423d204e7ca71a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:56.730489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6583d25-8b11-4ff4-aa83-42b44e2680f3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:56.732249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 433/885] 10.222.0.52 () {56 vars in 1183 bytes} [Fri Oct 28 19:45:56 2022] GET /identity/v3/domains/457ae8301d9e40dc97423d204e7ca71a => generated 267 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:56.742183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e025a-53a7-4db8-b170-c1d2d8779a38 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:56.868118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e025a-53a7-4db8-b170-c1d2d8779a38 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:56.910550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7ad7d-0fd9-41b6-91a4-41a02365332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:56.911622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7ad7d-0fd9-41b6-91a4-41a02365332a None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:56.912075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7ad7d-0fd9-41b6-91a4-41a02365332a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:56.912515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7ad7d-0fd9-41b6-91a4-41a02365332a None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:56.913562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7ad7d-0fd9-41b6-91a4-41a02365332a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:56.916018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7ad7d-0fd9-41b6-91a4-41a02365332a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:56.939788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:56.955449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 453/886] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:45:56 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:45:59.328773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdbfed-a89c-4d1c-85b9-07137f89483b None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:59.329600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdbfed-a89c-4d1c-85b9-07137f89483b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:59.329600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdbfed-a89c-4d1c-85b9-07137f89483b None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:59.331153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 434/887] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:45:59.337888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6394-a391-4dec-a915-8e4dff380ced None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:59.338484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6394-a391-4dec-a915-8e4dff380ced None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:59.338484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6394-a391-4dec-a915-8e4dff380ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:59.359393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c79f6394-a391-4dec-a915-8e4dff380ced None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:45:59.360780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c79f6394-a391-4dec-a915-8e4dff380ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:45:59.438581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 454/888] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:45:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:45:59.717314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdbfed-a89c-4d1c-85b9-07137f89483b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:45:59.811084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:45:59.845137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdbfed-a89c-4d1c-85b9-07137f89483b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:45:59.888478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884e88f-ea02-4a6a-a6ac-fa951a05a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:45:59.889258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e88f-ea02-4a6a-a6ac-fa951a05a845 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:45:59.889571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e88f-ea02-4a6a-a6ac-fa951a05a845 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:45:59.889842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884e88f-ea02-4a6a-a6ac-fa951a05a845 None admin] PATH_INFO: `/v3/domains/457ae8301d9e40dc97423d204e7ca71a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:45:59.891132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e88f-ea02-4a6a-a6ac-fa951a05a845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=457ae8301d9e40dc97423d204e7ca71a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:45:59.892992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884e88f-ea02-4a6a-a6ac-fa951a05a845 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:45:59.894709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 435/889] 10.222.0.52 () {56 vars in 1183 bytes} [Fri Oct 28 19:45:59 2022] GET /identity/v3/domains/457ae8301d9e40dc97423d204e7ca71a => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:45:59.901536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6394-a391-4dec-a915-8e4dff380ced None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:00.019456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6394-a391-4dec-a915-8e4dff380ced None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:00.047010 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:00.060985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf4676-348f-4ced-82b8-9cdc5a0e667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:00.061655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4676-348f-4ced-82b8-9cdc5a0e667d None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:00.061933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4676-348f-4ced-82b8-9cdc5a0e667d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:00.062204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf4676-348f-4ced-82b8-9cdc5a0e667d None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:00.062865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4676-348f-4ced-82b8-9cdc5a0e667d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:00.064377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf4676-348f-4ced-82b8-9cdc5a0e667d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:00.094612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 455/890] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:45:59 2022] POST /identity/v3/users => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:46:02.413876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ff0a3-2865-4f93-8d7a-59f602488ce2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:02.414501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ff0a3-2865-4f93-8d7a-59f602488ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:02.414501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ff0a3-2865-4f93-8d7a-59f602488ce2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:02.416043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 436/891] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:02.422996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a548a-bd55-41aa-a5af-3abd593b825e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:02.423636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a548a-bd55-41aa-a5af-3abd593b825e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:02.423636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a548a-bd55-41aa-a5af-3abd593b825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:02.444313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c86a548a-bd55-41aa-a5af-3abd593b825e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:02.445657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c86a548a-bd55-41aa-a5af-3abd593b825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:02.525783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 456/892] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:46:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:46:02.803882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ff0a3-2865-4f93-8d7a-59f602488ce2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:02.924455 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ff0a3-2865-4f93-8d7a-59f602488ce2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:02.963232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:02.963925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:02.964260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:02.964581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:02.977758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:46:02.983134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:46:02.985133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:46:02.987003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 437/893] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:46:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:46:02.994645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a548a-bd55-41aa-a5af-3abd593b825e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:03.112728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a548a-bd55-41aa-a5af-3abd593b825e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:03.126595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:03.157022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:03.157737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:03.158032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:03.158315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:03.159065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:46:03.159396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:03.160877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:03.171048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 457/894] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:46:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:46:03.177568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:03.181723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:03.297362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b7c2d-9229-46fb-846c-e0385dbfdf87 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:03.338408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:03.339144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:03.339461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:03.339770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] PATH_INFO: `/v3/users/39bd3ad859364b14a8b9bb0687786ac7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:03.356159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=39bd3ad859364b14a8b9bb0687786ac7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:03.357675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:03.359424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 438/895] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:46:03 2022] GET /identity/v3/users/39bd3ad859364b14a8b9bb0687786ac7 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:46:03.366524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:03.486138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f18d-40fe-40c6-bc3f-1a403908f4d3 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:03.540940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228e2da-4b4d-47dc-a028-2156b213c15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:03.541728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228e2da-4b4d-47dc-a028-2156b213c15b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:03.542055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228e2da-4b4d-47dc-a028-2156b213c15b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:03.542377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228e2da-4b4d-47dc-a028-2156b213c15b None admin] PATH_INFO: `/v3/projects/163d42f410e2447a8cfafb2f42e5f415` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:03.543682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228e2da-4b4d-47dc-a028-2156b213c15b None admin] RBAC: Authorizing `identity:get_project(project_id=163d42f410e2447a8cfafb2f42e5f415)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:03.545235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3228e2da-4b4d-47dc-a028-2156b213c15b None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:03.547158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 458/896] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:46:03 2022] GET /identity/v3/projects/163d42f410e2447a8cfafb2f42e5f415 => generated 361 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:46:03.557038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:03.629681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:03.677919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b1e1c-8cb1-4256-b44c-d2fa700d6ff3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:03.716995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5cc81-b46f-465f-ba64-e6f076fea230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:03.717709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5cc81-b46f-465f-ba64-e6f076fea230 None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:03.718020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5cc81-b46f-465f-ba64-e6f076fea230 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:03.718287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5cc81-b46f-465f-ba64-e6f076fea230 None admin] PATH_INFO: `/v3/projects/163d42f410e2447a8cfafb2f42e5f415/users/39bd3ad859364b14a8b9bb0687786ac7/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:03.720394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5cc81-b46f-465f-ba64-e6f076fea230 None admin] RBAC: Authorizing `identity:create_grant(project_id=163d42f410e2447a8cfafb2f42e5f415, user_id=39bd3ad859364b14a8b9bb0687786ac7, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:03.721890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5cc81-b46f-465f-ba64-e6f076fea230 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:03.737648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 439/897] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:46:03 2022] PUT /identity/v3/projects/163d42f410e2447a8cfafb2f42e5f415/users/39bd3ad859364b14a8b9bb0687786ac7/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:46:06.079904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb378c-b425-4c1a-adbb-654328869c93 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.080510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb378c-b425-4c1a-adbb-654328869c93 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.080861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb378c-b425-4c1a-adbb-654328869c93 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.083536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 459/898] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:46:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:46:06.090034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad899d-5c10-4ffe-8a15-9cf6f5a879c0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.090595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad899d-5c10-4ffe-8a15-9cf6f5a879c0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.090595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad899d-5c10-4ffe-8a15-9cf6f5a879c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.110641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-85ad899d-5c10-4ffe-8a15-9cf6f5a879c0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:46:06.111855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-85ad899d-5c10-4ffe-8a15-9cf6f5a879c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:46:06.192125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 440/899] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:46:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:46:06.471324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb378c-b425-4c1a-adbb-654328869c93 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:06.531994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:06.602423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb378c-b425-4c1a-adbb-654328869c93 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:06.651469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:06.652520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.652982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.653499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.673784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:46:06.683377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:46:06.684699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:46:06.685705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 460/900] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:46:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:46:06.692715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad899d-5c10-4ffe-8a15-9cf6f5a879c0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:06.761298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:06.850963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad899d-5c10-4ffe-8a15-9cf6f5a879c0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:06.894544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:06.895174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:06.895449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:06.895723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:06.896435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:46:06.896748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:06.898237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:06.908524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 441/901] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:46:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:46:06.915855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:07.040686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:07.044024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e0fa-132f-472d-9033-08bd9fb9a4f5 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:07.087593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:07.088662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:07.089146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:07.089669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] PATH_INFO: `/v3/users/39bd3ad859364b14a8b9bb0687786ac7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:07.091823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] RBAC: Authorizing `identity:get_user(user_id=39bd3ad859364b14a8b9bb0687786ac7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:07.094753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:07.097790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 461/902] 10.222.0.52 () {56 vars in 1177 bytes} [Fri Oct 28 19:46:06 2022] GET /identity/v3/users/39bd3ad859364b14a8b9bb0687786ac7 => generated 311 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:46:07.105096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:07.219589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad44d533-39bb-4902-9e39-f1cc3bd3b178 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:07.237716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:07.263458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:07.264081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:07.264356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:07.264623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:07.345877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:07.347249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:07.466204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 442/903] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:46:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:46:07.472972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:07.594001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1245960-eaf0-45f3-9e2b-431001a1be8e None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:07.633037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00817c11-222a-44ec-bef4-f014c4dec131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:07.633628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00817c11-222a-44ec-bef4-f014c4dec131 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:07.633908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00817c11-222a-44ec-bef4-f014c4dec131 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:07.634179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00817c11-222a-44ec-bef4-f014c4dec131 None admin] PATH_INFO: `/v3/projects/163d42f410e2447a8cfafb2f42e5f415` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:07.635337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00817c11-222a-44ec-bef4-f014c4dec131 None admin] RBAC: Authorizing `identity:get_project(project_id=163d42f410e2447a8cfafb2f42e5f415)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:07.636811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00817c11-222a-44ec-bef4-f014c4dec131 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:07.638567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 462/904] 10.222.0.52 () {56 vars in 1186 bytes} [Fri Oct 28 19:46:07 2022] GET /identity/v3/projects/163d42f410e2447a8cfafb2f42e5f415 => generated 361 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:46:07.649367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:46:07.666407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:07.769567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50242490-c0ea-418e-b4ad-4e2147d892f0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:46:07.810434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b241e-b8b0-4d44-ab8d-77f72b6eb05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:46:07.811131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b241e-b8b0-4d44-ab8d-77f72b6eb05b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:46:07.811450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b241e-b8b0-4d44-ab8d-77f72b6eb05b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:46:07.811765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b241e-b8b0-4d44-ab8d-77f72b6eb05b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:46:07.812545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b241e-b8b0-4d44-ab8d-77f72b6eb05b None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=163d42f410e2447a8cfafb2f42e5f415, user.id=39bd3ad859364b14a8b9bb0687786ac7) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:46:07.812892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b241e-b8b0-4d44-ab8d-77f72b6eb05b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:46:07.814496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b241e-b8b0-4d44-ab8d-77f72b6eb05b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:46:07.821640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 443/905] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:46:07 2022] GET /identity/v3/role_assignments?user.id=39bd3ad859364b14a8b9bb0687786ac7&scope.project.id=163d42f410e2447a8cfafb2f42e5f415&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:46:17.628686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=82 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:46:17.818405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=62 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:09.523391 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e824-364a-4f69-bd55-0e2991a8b248 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:09.524069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e824-364a-4f69-bd55-0e2991a8b248 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:09.524069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492e824-364a-4f69-bd55-0e2991a8b248 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:09.525401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 463/906] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:09.531919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a1a2-d042-47a4-81b1-e4ecdc5e6874 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:09.532812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a1a2-d042-47a4-81b1-e4ecdc5e6874 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:09.532812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6a1a2-d042-47a4-81b1-e4ecdc5e6874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:09.555124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-43a6a1a2-d042-47a4-81b1-e4ecdc5e6874 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:09.556603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-43a6a1a2-d042-47a4-81b1-e4ecdc5e6874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:09.685683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 444/907] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:47:09.979942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e824-364a-4f69-bd55-0e2991a8b248 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:10.135394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492e824-364a-4f69-bd55-0e2991a8b248 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:10.183214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:10.183891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:10.184169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:10.184439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:10.200496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:10.202055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:10.221109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:10.222507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:10.223875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:10.223875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:10.223875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:10.228110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 464/908] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:10.229236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a1a2-d042-47a4-81b1-e4ecdc5e6874 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:10.435776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6a1a2-d042-47a4-81b1-e4ecdc5e6874 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:10.494987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:10.506512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b7f94-a3e6-4cbf-b49d-261f39a3e645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:10.509612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b7f94-a3e6-4cbf-b49d-261f39a3e645 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:10.509612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b7f94-a3e6-4cbf-b49d-261f39a3e645 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:10.509612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b7f94-a3e6-4cbf-b49d-261f39a3e645 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:10.510619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b7f94-a3e6-4cbf-b49d-261f39a3e645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:10.511625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b7f94-a3e6-4cbf-b49d-261f39a3e645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:10.515101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b7f94-a3e6-4cbf-b49d-261f39a3e645 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:10.541575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 445/909] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:10.550570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:10.665744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:10.771545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55762da5-17c5-483c-8b6d-28836f37b3d0 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:10.866840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3ea51-6a81-44cb-bfbb-995cf7e00100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:10.867801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3ea51-6a81-44cb-bfbb-995cf7e00100 None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:10.868243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3ea51-6a81-44cb-bfbb-995cf7e00100 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:10.868758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3ea51-6a81-44cb-bfbb-995cf7e00100 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:10.869644 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3ea51-6a81-44cb-bfbb-995cf7e00100 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:10.871327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3ea51-6a81-44cb-bfbb-995cf7e00100 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:10.909657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 465/910] 10.222.0.52 () {60 vars in 1132 bytes} [Fri Oct 28 19:47:10 2022] POST /identity/v3/users => generated 251 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:47:13.729186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dec81-de64-463b-88f9-d899ad47c5f5 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:13.729849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dec81-de64-463b-88f9-d899ad47c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:13.729849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dec81-de64-463b-88f9-d899ad47c5f5 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:13.731526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 446/911] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:13.738992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edead-a481-4f46-bc2c-107487f56a49 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:13.739819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edead-a481-4f46-bc2c-107487f56a49 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:13.740123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edead-a481-4f46-bc2c-107487f56a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:13.772169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0b0edead-a481-4f46-bc2c-107487f56a49 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:13.773579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0b0edead-a481-4f46-bc2c-107487f56a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:13.881072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 466/912] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:47:14.165219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dec81-de64-463b-88f9-d899ad47c5f5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:14.361132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dec81-de64-463b-88f9-d899ad47c5f5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:14.413897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:14.414954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:14.415479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:14.415901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:14.437026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:47:14.447116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:14.448198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:47:14.449062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:14.457616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 447/913] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:47:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:14.459866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0edead-a481-4f46-bc2c-107487f56a49 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:14.529439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:14.631716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0edead-a481-4f46-bc2c-107487f56a49 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:14.706688 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:14.709019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:14.712304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:14.712304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:14.712304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:14.712304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:14.713547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:14.740999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 467/914] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:47:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:14.750840 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:14.829609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:14.926177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f085c0-99de-4d73-a490-5851cc04c368 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:14.992226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:14.992931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:14.993209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:14.993525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.006653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:15.008256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:15.026726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:15.028909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:15.030851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:15.030851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:15.030851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:15.033239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 448/915] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:47:15.034692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:15.168755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:15.174699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97741c-8b62-4ff5-abfb-832274db66ed None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:15.224157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:15.224834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:15.225112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:15.225451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.226068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:15.226371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:15.227832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:15.243422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 468/916] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:15.249477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:15.373803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df4009-2265-440a-b9eb-425222c42bee None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:15.376044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:15.424817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:15.425819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:15.426155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:15.426425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.435905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:15.437291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:47:15.460323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:15.461472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:15.462420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 449/917] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:15.468150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:15.635066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f2b3e-00c9-4f9d-8828-45109f60643c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:15.683849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:15.684696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:15.685064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:15.685454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.686556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:15.686949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:15.689126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:15.723694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 469/918] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Oct 28 19:47:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:15.729627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:15.891214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218816d2-05f1-4252-a9e1-c51496cff162 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:15.934869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:15.935715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:15.936310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:15.936617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:15.950419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:15.952015 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:15.968175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:15.969502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:15.971391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:15.971391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:15.971391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:15.971391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 450/919] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:15.975774 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:15.998353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:16.120709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646993b-b533-4ee5-bc2e-1ed313f83976 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:16.165936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:16.166626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:16.167077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:16.167623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:16.168628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:16.169094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:16.171552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:16.191203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 470/920] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:16.199990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:16.228317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:16.347889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc39dd5-9b77-4bcc-b704-ec33ee003bce None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:16.405137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:16.406224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:16.406713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:16.407173 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:16.422133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:16.424892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:47:16.446899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:16.448626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:16.450184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 451/921] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:47:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:47:16.459232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:16.606341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:16.635466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7519d-0a36-464c-8407-0adfa17f52ff None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:16.698162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead28e77-4e25-46b1-9b89-10220769c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:16.698917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28e77-4e25-46b1-9b89-10220769c699 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:16.699302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28e77-4e25-46b1-9b89-10220769c699 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:16.699669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead28e77-4e25-46b1-9b89-10220769c699 None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:16.700492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead28e77-4e25-46b1-9b89-10220769c699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:16.700897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead28e77-4e25-46b1-9b89-10220769c699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:16.702889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead28e77-4e25-46b1-9b89-10220769c699 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:16.724602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 471/922] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:47:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:16.732214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:16.832609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:16.865164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77745-a500-4e1c-8f1d-1acd88bc60a0 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:16.909959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505839db-77a8-4b6e-a681-99c0690e3f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:16.911091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505839db-77a8-4b6e-a681-99c0690e3f5d None admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:16.911417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505839db-77a8-4b6e-a681-99c0690e3f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:16.911846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505839db-77a8-4b6e-a681-99c0690e3f5d None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/762f6a1257db4dde93c6aaf2d02ca73d/roles/397543bbcaeb4ccfb989c8a046f27b2f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:16.932302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505839db-77a8-4b6e-a681-99c0690e3f5d None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=762f6a1257db4dde93c6aaf2d02ca73d, role_id=397543bbcaeb4ccfb989c8a046f27b2f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:16.935648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505839db-77a8-4b6e-a681-99c0690e3f5d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:16.956329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 452/923] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:47:16 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/762f6a1257db4dde93c6aaf2d02ca73d/roles/397543bbcaeb4ccfb989c8a046f27b2f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:47:19.377080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f803d-8afc-4ca6-bfed-0a5a65ef2284 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:19.377814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f803d-8afc-4ca6-bfed-0a5a65ef2284 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:19.377814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f803d-8afc-4ca6-bfed-0a5a65ef2284 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:19.379095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 472/924] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:19.385591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e06e-8d06-4049-b586-dacf22c0f52a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:19.386449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e06e-8d06-4049-b586-dacf22c0f52a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:19.387017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481e06e-8d06-4049-b586-dacf22c0f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:19.409745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9481e06e-8d06-4049-b586-dacf22c0f52a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:19.411358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9481e06e-8d06-4049-b586-dacf22c0f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:19.504109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 453/925] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:47:19.789528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f803d-8afc-4ca6-bfed-0a5a65ef2284 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:19.917714 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f803d-8afc-4ca6-bfed-0a5a65ef2284 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:19.955348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:19.955992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:19.956321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:19.956535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:19.964849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:19.969628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:47:19.975108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:19.976420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:19.977603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 473/926] 10.222.0.52 () {56 vars in 1102 bytes} [Fri Oct 28 19:47:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:19.986919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481e06e-8d06-4049-b586-dacf22c0f52a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:20.056704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:20.116507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481e06e-8d06-4049-b586-dacf22c0f52a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:20.154054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:20.154721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:20.155001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:20.155272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:20.155948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] RBAC: Adding query filter params (name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:20.156250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:20.157692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:20.169409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 454/927] 10.222.0.52 () {56 vars in 1103 bytes} [Fri Oct 28 19:47:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:20.176381 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:20.338193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630417ff-3a53-43b2-9da0-4cb7d94e0ba4 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:20.401959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:20.403140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:20.403630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:20.404107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:20.422599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:20.424819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:20.448215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:20.450827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:20.453474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:20.453474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:20.453474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:20.453474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 474/928] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:20.458690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:20.612980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a092-8116-4149-9199-f2f7469da9be None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:20.634541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:20.661208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:20.661992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:20.662374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:20.662705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:20.663463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:20.668998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:20.671500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:20.692354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 455/929] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:20.704741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:20.798894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:20.880359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b4269-d74a-4d8b-a09b-ef80eb32b85d None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:20.936656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:20.937622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:20.938003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:20.938336 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:20.949017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:20.950729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:47:20.966938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:20.968888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:20.970944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 475/930] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:20.978773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:21.124326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f8993-987f-4d8c-879c-7f13514b29f6 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:21.174436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:21.175026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:21.175309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:21.175584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:21.176341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:21.176671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:21.178163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:21.212413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 456/931] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Oct 28 19:47:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:47:21.221258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:21.373072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6609a5-f961-4d5b-9a80-a03f0bdaf793 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:21.385103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:21.413601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:21.414633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:21.414633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:21.414950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:21.530124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:21.531034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:21.695773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 476/932] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:47:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:47:21.702950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:21.759604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:21.864851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37c8e-5902-468e-b04c-64f01863edb2 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:21.916769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:21.917403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:21.917754 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:21.918065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:21.932911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:21.935566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:21.960821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:21.962996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:21.971853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:21.971853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:21.971853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:21.971853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 457/933] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:21.972274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:21.990205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:22.155789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e441550-d828-44e6-8650-5d5cb474f7fa None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:22.210701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:22.211331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:22.211610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:22.211960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:22.212651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:22.213000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:22.214658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:22.228603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 477/934] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:22.236565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:22.347012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:22.372920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db36d48-37e2-45dd-a002-6ab7b9c36e8c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:22.426080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:22.426771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:22.427073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:22.427318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:22.438407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:22.440767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:47:22.454090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:22.455618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:22.456994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 458/935] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:47:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:22.463166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:22.562503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:22.615308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2bc51-4072-4bb7-910a-849916b6f737 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:22.658897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52571d48-9c8a-4d47-afee-0522627f439a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:22.659659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52571d48-9c8a-4d47-afee-0522627f439a None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:22.660047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52571d48-9c8a-4d47-afee-0522627f439a None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:22.660414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52571d48-9c8a-4d47-afee-0522627f439a None admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:22.661224 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52571d48-9c8a-4d47-afee-0522627f439a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:22.661659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52571d48-9c8a-4d47-afee-0522627f439a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:22.663298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52571d48-9c8a-4d47-afee-0522627f439a None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:22.679130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 478/936] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:47:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:22.691544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:22.849908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ebaa64-61ba-46f5-8e67-949c9f15ed54 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:22.908803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667409b-6169-4212-b870-f8f28bbda1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:22.909978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667409b-6169-4212-b870-f8f28bbda1eb None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:22.910445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667409b-6169-4212-b870-f8f28bbda1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:22.910912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667409b-6169-4212-b870-f8f28bbda1eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:22.912454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667409b-6169-4212-b870-f8f28bbda1eb None admin] RBAC: Adding query filter params (role.id=397543bbcaeb4ccfb989c8a046f27b2f, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=762f6a1257db4dde93c6aaf2d02ca73d) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:22.912972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667409b-6169-4212-b870-f8f28bbda1eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:22.915922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667409b-6169-4212-b870-f8f28bbda1eb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:22.927029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 459/937] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:47:22 2022] GET /identity/v3/role_assignments?user.id=762f6a1257db4dde93c6aaf2d02ca73d&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=397543bbcaeb4ccfb989c8a046f27b2f => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:25.494385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d178-0f38-4bf8-b402-500531fbb9f4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:25.494385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d178-0f38-4bf8-b402-500531fbb9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:25.494385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161d178-0f38-4bf8-b402-500531fbb9f4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:25.494385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 479/938] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:25.502888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a49483-5e38-4ed9-9180-bfa12dbddbed None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:25.503620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a49483-5e38-4ed9-9180-bfa12dbddbed None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:25.503811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a49483-5e38-4ed9-9180-bfa12dbddbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:25.526952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-46a49483-5e38-4ed9-9180-bfa12dbddbed None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:25.528270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-46a49483-5e38-4ed9-9180-bfa12dbddbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:25.532208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:25.627980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 460/939] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:47:25.925534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161d178-0f38-4bf8-b402-500531fbb9f4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:26.086720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161d178-0f38-4bf8-b402-500531fbb9f4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:26.135105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:26.144903 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:26.145797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:26.146133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:26.146589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:26.163052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:47:26.170738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:26.172936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:26.174214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 480/940] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:47:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:47:26.181201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a49483-5e38-4ed9-9180-bfa12dbddbed None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:26.336207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a49483-5e38-4ed9-9180-bfa12dbddbed None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:26.388147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:26.389070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:26.389606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:26.390110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:26.391524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:26.392069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:26.394755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:26.408600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 461/941] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:47:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:26.416372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:26.580681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc1a18-f5fe-443c-a5ee-46ce1d829b3b None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:26.646534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:26.647530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:26.648006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:26.648482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:26.668568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:26.671506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:26.701611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:26.703575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:26.705591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:26.705591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:26.705591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:26.705591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 481/942] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:26.712782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:26.718403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:26.898999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fa813-184d-4633-8904-65899dfb89b8 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:26.957931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:26.959037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:26.959419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:26.959794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:26.960805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:26.961320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:26.963394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:26.993676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 462/943] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:26.997006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:27.071920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:27.166441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae75d78-0f78-40ef-a603-6fe9f11ab9bb None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:27.226541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:27.227596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:27.228105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:27.228535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:27.241199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:27.243055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:47:27.260781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:27.263138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:27.265114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 482/944] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:27.277440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:27.381564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:27.444347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6528e8-c730-48bc-bfe7-fe3e8020619d None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:27.492098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:27.492899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:27.493275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:27.493685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:27.494586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:27.495013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:27.496792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:27.525590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 463/945] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Oct 28 19:47:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:27.536282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:27.685176 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3904a8-102a-4402-8601-33d1ea240bb6 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:27.687298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:27.749750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:27.750534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:27.750976 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:27.751426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:27.769083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:27.771277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:27.790150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:27.791975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:27.793640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:27.793640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:27.793640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:27.793640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 483/946] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 28 19:47:27.798431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:27.928812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab07507-2dbf-4e23-a62c-89e790e4f13c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:27.954403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:27.973040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:27.973939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:27.974234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:27.974507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:27.975177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:27.975551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:27.977115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:27.991127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 464/947] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:27.997944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:28.150953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c9fe-6d21-4ea9-8774-27d6c9ad0813 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:28.212083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:28.213369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:28.213970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:28.214542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:28.227866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:28.230906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:47:28.255493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:28.256751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:28.263959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 484/948] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:47:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:28.265153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:28.408981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf55e9e-709f-4ffd-aed9-ec9a692c35c3 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:28.457745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af35c2-e9ad-47a5-aef5-6ecbe66882aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:28.458620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af35c2-e9ad-47a5-aef5-6ecbe66882aa None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:28.458978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af35c2-e9ad-47a5-aef5-6ecbe66882aa None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:28.459385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af35c2-e9ad-47a5-aef5-6ecbe66882aa None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:28.460337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af35c2-e9ad-47a5-aef5-6ecbe66882aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:28.460798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af35c2-e9ad-47a5-aef5-6ecbe66882aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:28.462535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af35c2-e9ad-47a5-aef5-6ecbe66882aa None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:28.488173 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 465/949] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:28.490382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:28.514981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:28.646549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18890e9d-6076-49e7-beb6-f03d55fe7b1c None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:28.706198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9433db-835a-4ad8-97cf-ff121f1410e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:28.707081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9433db-835a-4ad8-97cf-ff121f1410e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:28.707443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9433db-835a-4ad8-97cf-ff121f1410e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:28.707846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9433db-835a-4ad8-97cf-ff121f1410e8 None admin] PATH_INFO: `/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/762f6a1257db4dde93c6aaf2d02ca73d/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:28.711170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9433db-835a-4ad8-97cf-ff121f1410e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd2d0dbebcef4b298390f777e361b12d, user_id=762f6a1257db4dde93c6aaf2d02ca73d, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:28.713205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9433db-835a-4ad8-97cf-ff121f1410e8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:28.742259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 485/950] 10.222.0.52 () {58 vars in 1439 bytes} [Fri Oct 28 19:47:28 2022] PUT /identity/v3/projects/bd2d0dbebcef4b298390f777e361b12d/users/762f6a1257db4dde93c6aaf2d02ca73d/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:47:31.167224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff115b-5e94-43f1-a924-d96b6b750073 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:31.168126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff115b-5e94-43f1-a924-d96b6b750073 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:31.168126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff115b-5e94-43f1-a924-d96b6b750073 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:31.169985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 466/951] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:31.176589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08935-cf14-4167-9de5-bb45ff13eff0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:31.177238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08935-cf14-4167-9de5-bb45ff13eff0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:31.177238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08935-cf14-4167-9de5-bb45ff13eff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:31.198962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b0b08935-cf14-4167-9de5-bb45ff13eff0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:31.200267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b0b08935-cf14-4167-9de5-bb45ff13eff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:31.301427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 486/952] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:47:31.609944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff115b-5e94-43f1-a924-d96b6b750073 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:31.676746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:31.760073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff115b-5e94-43f1-a924-d96b6b750073 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:31.826476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:31.827585 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:31.828092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:31.828728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:31.848629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 28 19:47:31.854771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:31.856865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:31.858520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 467/953] 10.222.0.52 () {56 vars in 1096 bytes} [Fri Oct 28 19:47:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:31.865231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b08935-cf14-4167-9de5-bb45ff13eff0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:31.869855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:32.025065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b08935-cf14-4167-9de5-bb45ff13eff0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:32.079869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:32.080889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:32.081360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:32.081853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:32.083030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:32.083545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:32.086112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:32.102089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 487/954] 10.222.0.52 () {56 vars in 1099 bytes} [Fri Oct 28 19:47:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:32.108941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:32.270315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:32.275230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e5684-c3c1-4eea-8990-3c9b23bc3721 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:32.325669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:32.326362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:32.326595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:32.326867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:32.340131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:32.341671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:32.360144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:32.362673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:32.364817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:32.364817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:32.364817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:32.364817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 468/955] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:32.369177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:32.486511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:32.543894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af5205-631e-4114-a9b3-f94796b3c857 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:32.598358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:32.599338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:32.599733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:32.600066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:32.600955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:32.601421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:32.603293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:32.624246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 488/956] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:32.633125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:32.811902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c3917c-269e-4937-8501-3427afa606c1 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:32.858129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:32.859215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:32.859727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:32.860186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:32.873922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:32.876662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 28 19:47:32.900652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:32.902694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:32.912828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 469/957] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:32.914131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:33.068872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816a9a1-45a4-4966-be8b-7f91196745a8 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:33.104000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:33.119772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:33.120594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:33.120925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:33.121273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:33.122143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:33.122569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:33.124170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:33.150918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 489/958] 10.222.0.52 () {56 vars in 1143 bytes} [Fri Oct 28 19:47:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:33.159346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:33.182329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:33.326628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612f31-7a6d-4007-8d37-441be9c5f568 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:33.383019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:33.384040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:33.384311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:33.384578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:33.487222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:33.489945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:33.512716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:33.647610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 470/959] 10.222.0.52 () {58 vars in 1282 bytes} [Fri Oct 28 19:47:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 28 19:47:33.657021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:33.823260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e4208-9c71-4ef6-adae-f9163dd935ed None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:33.889244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:33.890545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:33.891245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:33.891784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:33.913460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:33.914940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 28 19:47:33.933042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:33.934277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 28 19:47:33.935525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 28 19:47:33.935525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 28 19:47:33.935525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:33.935525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 490/960] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:47:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:33.940591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:34.084598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43c9c-814b-4f3f-afb1-a90063f0af1c None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:34.106199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:34.133325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:34.133989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:34.134286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:34.134545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:34.135216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:34.135515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:34.137333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:34.150996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 471/961] 10.222.0.52 () {56 vars in 1109 bytes} [Fri Oct 28 19:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:34.157772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:34.201275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:34.283982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3061e-1555-4eb7-994c-028501bb2c72 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:34.327028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:34.327677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:34.327948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:34.328369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:34.336728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:34.338290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 28 19:47:34.351347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:34.352850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 28 19:47:34.354294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: ERROR keystone.server.flask.application Oct 28 19:47:34.358246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 491/962] 10.222.0.52 () {56 vars in 1111 bytes} [Fri Oct 28 19:47:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:34.359122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:34.491491 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6177193-1dc3-4b0a-b790-7b2c1e25bf5b None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:34.534774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6168d-7d45-40d4-a9df-12d6ada6e9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:34.535416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6168d-7d45-40d4-a9df-12d6ada6e9be None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:34.535689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6168d-7d45-40d4-a9df-12d6ada6e9be None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:34.535955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6168d-7d45-40d4-a9df-12d6ada6e9be None admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:34.536688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6168d-7d45-40d4-a9df-12d6ada6e9be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:34.536987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6168d-7d45-40d4-a9df-12d6ada6e9be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:34.538564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6168d-7d45-40d4-a9df-12d6ada6e9be None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:34.554418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 472/963] 10.222.0.52 () {56 vars in 1148 bytes} [Fri Oct 28 19:47:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:47:34.561535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:34.687371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:34.697768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3ace43-6038-4c72-a8fa-4299fb13e598 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:34.769236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144ee20-288f-4c70-a3f3-a9abf5581623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:34.769941 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ee20-288f-4c70-a3f3-a9abf5581623 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:34.770323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ee20-288f-4c70-a3f3-a9abf5581623 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:34.770777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144ee20-288f-4c70-a3f3-a9abf5581623 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:34.771997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144ee20-288f-4c70-a3f3-a9abf5581623 None admin] RBAC: Adding query filter params (role.id=16542b0f593541a195074d7863391bd7, scope.project.id=bd2d0dbebcef4b298390f777e361b12d, user.id=762f6a1257db4dde93c6aaf2d02ca73d) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:34.772414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144ee20-288f-4c70-a3f3-a9abf5581623 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:34.774075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144ee20-288f-4c70-a3f3-a9abf5581623 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:34.782938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 492/964] 10.222.0.52 () {56 vars in 1374 bytes} [Fri Oct 28 19:47:34 2022] GET /identity/v3/role_assignments?user.id=762f6a1257db4dde93c6aaf2d02ca73d&scope.project.id=bd2d0dbebcef4b298390f777e361b12d&role.id=16542b0f593541a195074d7863391bd7 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:37.214369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a174cb-56d0-4153-a0ba-21084467f1ab None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:37.215007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a174cb-56d0-4153-a0ba-21084467f1ab None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:37.215007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a174cb-56d0-4153-a0ba-21084467f1ab None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:37.216527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 473/965] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:37.222946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0444-dc87-425e-9f62-3cc669785e68 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:37.223493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0444-dc87-425e-9f62-3cc669785e68 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:37.223493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac0444-dc87-425e-9f62-3cc669785e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:37.244864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-70ac0444-dc87-425e-9f62-3cc669785e68 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:37.246143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-70ac0444-dc87-425e-9f62-3cc669785e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:37.328004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 493/966] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:47:37.610339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a174cb-56d0-4153-a0ba-21084467f1ab None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:37.667757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:37.785016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a174cb-56d0-4153-a0ba-21084467f1ab None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:37.827723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:37.828420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:37.828696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:37.828960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] PATH_INFO: `/v3/services/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:37.829587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:37.830992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:37.841076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:37.843157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:37.844950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 474/967] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:47:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:37.849109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac0444-dc87-425e-9f62-3cc669785e68 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:37.962201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:37.974722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac0444-dc87-425e-9f62-3cc669785e68 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:38.015498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd8ae8-ee69-4167-8a6b-a4b5deef7e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:38.016191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8ae8-ee69-4167-8a6b-a4b5deef7e9d None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:38.016544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8ae8-ee69-4167-8a6b-a4b5deef7e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:38.016863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8ae8-ee69-4167-8a6b-a4b5deef7e9d None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:38.017625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd8ae8-ee69-4167-8a6b-a4b5deef7e9d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:38.017980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd8ae8-ee69-4167-8a6b-a4b5deef7e9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:38.019658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd8ae8-ee69-4167-8a6b-a4b5deef7e9d None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:38.025934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 494/968] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Oct 28 19:47:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:38.032594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:38.147172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:38.154930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcadb38-a661-4c2a-95a6-513d27c626be None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:38.196936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d40ced8-c54a-4d1f-80ef-e4c3d9e58963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:38.197700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ced8-c54a-4d1f-80ef-e4c3d9e58963 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:38.197980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ced8-c54a-4d1f-80ef-e4c3d9e58963 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:38.198253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d40ced8-c54a-4d1f-80ef-e4c3d9e58963 None admin] PATH_INFO: `/v3/services` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:38.198894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ced8-c54a-4d1f-80ef-e4c3d9e58963 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:38.199192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ced8-c54a-4d1f-80ef-e4c3d9e58963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:38.200599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d40ced8-c54a-4d1f-80ef-e4c3d9e58963 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:38.206388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 475/969] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Oct 28 19:47:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:47:40.477966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6278f-566a-4080-8c30-568ac462f313 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:40.478595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6278f-566a-4080-8c30-568ac462f313 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:40.478595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6278f-566a-4080-8c30-568ac462f313 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:40.480032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 495/970] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:40.486437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca1fd6-9288-4c2a-a906-a7b00159aba1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:40.487010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca1fd6-9288-4c2a-a906-a7b00159aba1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:40.487010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca1fd6-9288-4c2a-a906-a7b00159aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:40.508025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0aca1fd6-9288-4c2a-a906-a7b00159aba1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:40.509277 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0aca1fd6-9288-4c2a-a906-a7b00159aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:40.590891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 476/971] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:47:40.893412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6278f-566a-4080-8c30-568ac462f313 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:41.020976 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6278f-566a-4080-8c30-568ac462f313 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:41.062436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874a106-4ccf-4ba5-b459-4a1ddd3f4f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:41.063226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a106-4ccf-4ba5-b459-4a1ddd3f4f9c None admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:41.063566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a106-4ccf-4ba5-b459-4a1ddd3f4f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:41.063849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874a106-4ccf-4ba5-b459-4a1ddd3f4f9c None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:41.064544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874a106-4ccf-4ba5-b459-4a1ddd3f4f9c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:41.066074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874a106-4ccf-4ba5-b459-4a1ddd3f4f9c None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:41.083892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 496/972] 10.222.0.52 () {60 vars in 1141 bytes} [Fri Oct 28 19:47:40 2022] POST /identity/v3/services => generated 246 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:47:43.413902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d43b3-2908-46d9-a9e2-2349347b8349 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:43.414527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d43b3-2908-46d9-a9e2-2349347b8349 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:43.414527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d43b3-2908-46d9-a9e2-2349347b8349 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:43.415965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 477/973] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:43.423785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5bec-c7d7-468a-a197-f0f5db4e4d68 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:43.425599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5bec-c7d7-468a-a197-f0f5db4e4d68 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:43.425599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5bec-c7d7-468a-a197-f0f5db4e4d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:43.447689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2add5bec-c7d7-468a-a197-f0f5db4e4d68 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:43.448947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2add5bec-c7d7-468a-a197-f0f5db4e4d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:43.460944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:43.541870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 497/974] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 28 19:47:43.827518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d43b3-2908-46d9-a9e2-2349347b8349 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:43.955214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:43.968818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d43b3-2908-46d9-a9e2-2349347b8349 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:44.008720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:44.009464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:44.009796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:44.010478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:44.011131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:44.012633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:44.024495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:44.026477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:44.028208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 478/975] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:47:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:44.035339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5bec-c7d7-468a-a197-f0f5db4e4d68 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:44.160814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5bec-c7d7-468a-a197-f0f5db4e4d68 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:44.200070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:44.200734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:44.201016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:44.201286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:44.201971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:44.202348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:44.203732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:44.209939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 498/976] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Oct 28 19:47:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:44.216886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:44.335088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12626f26-40ad-45e9-b909-06e6802d5750 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:44.373590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243ef17-458e-4100-8a7f-0c970a2e3429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:44.374236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ef17-458e-4100-8a7f-0c970a2e3429 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:44.374516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ef17-458e-4100-8a7f-0c970a2e3429 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:44.374788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ef17-458e-4100-8a7f-0c970a2e3429 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:44.375498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243ef17-458e-4100-8a7f-0c970a2e3429 None admin] RBAC: Adding query filter params (interface=public, service_id=50a94b2d81e64e05b3b88b6b3d8530a6, region_id=RegionOne) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:44.375792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243ef17-458e-4100-8a7f-0c970a2e3429 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:44.377315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243ef17-458e-4100-8a7f-0c970a2e3429 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:44.383497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 479/977] 10.222.0.52 () {56 vars in 1251 bytes} [Fri Oct 28 19:47:44 2022] GET /identity/v3/endpoints?service_id=50a94b2d81e64e05b3b88b6b3d8530a6&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:44.390353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:44.394525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:44.507900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e38aa6-985c-40b0-bc2d-c9908b9c45e7 None admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:44.545700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b79611-3945-4a2e-8ff3-3f4d699b7520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:44.546368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79611-3945-4a2e-8ff3-3f4d699b7520 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:44.546651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79611-3945-4a2e-8ff3-3f4d699b7520 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:44.546896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b79611-3945-4a2e-8ff3-3f4d699b7520 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:44.547548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b79611-3945-4a2e-8ff3-3f4d699b7520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:44.548982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b79611-3945-4a2e-8ff3-3f4d699b7520 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:44.556823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 499/978] 10.222.0.52 () {56 vars in 1087 bytes} [Fri Oct 28 19:47:44 2022] GET /identity/v3/services => generated 2191 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:47:46.866695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058b26-49df-4322-aa5b-d3339ff2d6aa None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:46.867271 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058b26-49df-4322-aa5b-d3339ff2d6aa None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:46.867271 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce058b26-49df-4322-aa5b-d3339ff2d6aa None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:46.868821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 480/979] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:47:46.875123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7c07c-631f-40d2-848b-d6696a1c4506 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:46.875981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7c07c-631f-40d2-848b-d6696a1c4506 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:46.875981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7c07c-631f-40d2-848b-d6696a1c4506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:46.897414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7ab7c07c-631f-40d2-848b-d6696a1c4506 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:47:46.898650 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7ab7c07c-631f-40d2-848b-d6696a1c4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:47:46.969935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:46.977788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 500/980] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:47:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 28 19:47:47.272279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce058b26-49df-4322-aa5b-d3339ff2d6aa None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:47.294373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:47.443638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce058b26-49df-4322-aa5b-d3339ff2d6aa None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:47.506018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:47.506931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:47.507420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:47.507870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:47.508789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:47.511544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 28 19:47:47.522177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 28 19:47:47.524044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.get_or_create( Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application with Lock( Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self._enter() Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application return self.creator() Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application created_value = creator( Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: ERROR keystone.server.flask.application Oct 28 19:47:47.525360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 481/981] 10.222.0.52 () {56 vars in 1117 bytes} [Fri Oct 28 19:47:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 28 19:47:47.531848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7c07c-631f-40d2-848b-d6696a1c4506 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:47.702705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7c07c-631f-40d2-848b-d6696a1c4506 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:47.766246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0e072-694b-4b46-a596-a9fd1f9f6a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:47.767093 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0e072-694b-4b46-a596-a9fd1f9f6a87 None admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:47.767493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0e072-694b-4b46-a596-a9fd1f9f6a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:47.768003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0e072-694b-4b46-a596-a9fd1f9f6a87 None admin] PATH_INFO: `/v3/services` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:47.769100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0e072-694b-4b46-a596-a9fd1f9f6a87 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:47:47.769610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0e072-694b-4b46-a596-a9fd1f9f6a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:47.772157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f0e072-694b-4b46-a596-a9fd1f9f6a87 None admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:47.781548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 501/982] 10.222.0.52 () {56 vars in 1116 bytes} [Fri Oct 28 19:47:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:47:47.788198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:47:47.890401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:47.915737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371c8a0-11e6-41e2-8c38-4354e1286b09 None admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:47:47.957236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074cb6-3b54-4d48-a98f-0716609c35eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:47:47.957900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074cb6-3b54-4d48-a98f-0716609c35eb None admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:47:47.958175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074cb6-3b54-4d48-a98f-0716609c35eb None admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:47:47.958444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074cb6-3b54-4d48-a98f-0716609c35eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:47:47.959138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074cb6-3b54-4d48-a98f-0716609c35eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:47:47.960567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074cb6-3b54-4d48-a98f-0716609c35eb None admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:47:47.985045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 482/983] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:47:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:47:57.776339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=69 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:47:57.979356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:48:58.907275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c324-8a69-4d7e-9d6f-98ca7f8dda77 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:58.908659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c324-8a69-4d7e-9d6f-98ca7f8dda77 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:58.909320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c324-8a69-4d7e-9d6f-98ca7f8dda77 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:58.920971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfec89-d10e-4c37-9c82-d935335c0049 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:58.922381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfec89-d10e-4c37-9c82-d935335c0049 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:58.923042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfec89-d10e-4c37-9c82-d935335c0049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:58.925964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 502/984] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:48:58 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:48:59.086348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-74cfec89-d10e-4c37-9c82-d935335c0049 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:48:59.089482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-74cfec89-d10e-4c37-9c82-d935335c0049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:59.265914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 483/985] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:48:59.569360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbafd-acd4-4adc-8cfe-92ae6c711622 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:59.569921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbafd-acd4-4adc-8cfe-92ae6c711622 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:59.570186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54fbafd-acd4-4adc-8cfe-92ae6c711622 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:59.571790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 503/986] 10.222.0.52 () {54 vars in 965 bytes} [Fri Oct 28 19:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:48:59.580208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc609d4-5783-42ef-8658-b637729c90a4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:48:59.580482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc609d4-5783-42ef-8658-b637729c90a4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:48:59.580933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc609d4-5783-42ef-8658-b637729c90a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:48:59.690650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-acc609d4-5783-42ef-8658-b637729c90a4 None None] MFA Rules not processed for user `7157e60fb6fb4b84866ce59f051a9037`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:48:59.692262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-acc609d4-5783-42ef-8658-b637729c90a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:59.727091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:48:59.795319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 484/987] 10.222.0.52 () {58 vars in 1062 bytes} [Fri Oct 28 19:48:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:48:59.805126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fbafd-acd4-4adc-8cfe-92ae6c711622 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:48:59.806994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f54fbafd-acd4-4adc-8cfe-92ae6c711622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:48:59.948117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54fbafd-acd4-4adc-8cfe-92ae6c711622 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:00.033844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e941e95-68bf-4b56-abda-84c850361b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:00.034872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941e95-68bf-4b56-abda-84c850361b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:00.035374 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941e95-68bf-4b56-abda-84c850361b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:00.035852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e941e95-68bf-4b56-abda-84c850361b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:00.037731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7e941e95-68bf-4b56-abda-84c850361b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:00.111085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:00.185484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941e95-68bf-4b56-abda-84c850361b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:00.187692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e941e95-68bf-4b56-abda-84c850361b11 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:00.220589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 504/988] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:02.814282 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfefd3-86e7-4bad-beaf-c38ed58e914e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:02.814869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfefd3-86e7-4bad-beaf-c38ed58e914e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:02.814869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfefd3-86e7-4bad-beaf-c38ed58e914e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:02.816423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 485/989] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:02.824999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750509f5-ce00-4bbe-907f-a78c7e5587c9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:02.825602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750509f5-ce00-4bbe-907f-a78c7e5587c9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:02.825812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750509f5-ce00-4bbe-907f-a78c7e5587c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:02.928443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-750509f5-ce00-4bbe-907f-a78c7e5587c9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:02.930547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-750509f5-ce00-4bbe-907f-a78c7e5587c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:03.087528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 505/990] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:03.367004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfefd3-86e7-4bad-beaf-c38ed58e914e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:03.368562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0bdfefd3-86e7-4bad-beaf-c38ed58e914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:03.487389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfefd3-86e7-4bad-beaf-c38ed58e914e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:03.575785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:03.579129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266201a-4479-40a2-8adb-c6b6ee49e26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:03.580304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266201a-4479-40a2-8adb-c6b6ee49e26d service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:03.580958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266201a-4479-40a2-8adb-c6b6ee49e26d service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:03.581555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266201a-4479-40a2-8adb-c6b6ee49e26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:03.584228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6266201a-4479-40a2-8adb-c6b6ee49e26d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:03.725114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266201a-4479-40a2-8adb-c6b6ee49e26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:03.726653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266201a-4479-40a2-8adb-c6b6ee49e26d service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:03.747492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 486/991] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:06.316150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1dc41-3633-4fb4-9b42-df2571d5fcfc None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:06.316816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1dc41-3633-4fb4-9b42-df2571d5fcfc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:06.316816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1dc41-3633-4fb4-9b42-df2571d5fcfc None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:06.318126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 506/992] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:06.324704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab084-131a-40ec-b2fd-7e1b5c3f0330 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:06.325267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab084-131a-40ec-b2fd-7e1b5c3f0330 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:06.325267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ab084-131a-40ec-b2fd-7e1b5c3f0330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:06.408013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-451ab084-131a-40ec-b2fd-7e1b5c3f0330 None None] MFA Rules not processed for user `1f7211cec2b84394b2a5f0d2d69692c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:06.409171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-451ab084-131a-40ec-b2fd-7e1b5c3f0330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:06.466974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:06.523198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 487/993] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:06.821000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852245-53d5-406a-83e5-b5fc21cc961c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:06.821272 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852245-53d5-406a-83e5-b5fc21cc961c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:06.821576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852245-53d5-406a-83e5-b5fc21cc961c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:06.822979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 507/994] 10.222.0.52 () {54 vars in 965 bytes} [Fri Oct 28 19:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:06.830537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500154-e9b1-4009-a57a-664c3b87ffb7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:06.830824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500154-e9b1-4009-a57a-664c3b87ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:06.831102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d500154-e9b1-4009-a57a-664c3b87ffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:06.915450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1d500154-e9b1-4009-a57a-664c3b87ffb7 None None] MFA Rules not processed for user `7157e60fb6fb4b84866ce59f051a9037`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:06.917312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1d500154-e9b1-4009-a57a-664c3b87ffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:07.007835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 488/995] 10.222.0.52 () {58 vars in 1062 bytes} [Fri Oct 28 19:49:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:07.018001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21852245-53d5-406a-83e5-b5fc21cc961c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:07.020480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-21852245-53d5-406a-83e5-b5fc21cc961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:07.033319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:07.144147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21852245-53d5-406a-83e5-b5fc21cc961c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:07.230407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a574435-889e-492d-bcfe-ebb18dfc6377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:07.231023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574435-889e-492d-bcfe-ebb18dfc6377 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:07.231317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574435-889e-492d-bcfe-ebb18dfc6377 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:07.231606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a574435-889e-492d-bcfe-ebb18dfc6377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:07.233223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5a574435-889e-492d-bcfe-ebb18dfc6377 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:07.300637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:07.352891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a574435-889e-492d-bcfe-ebb18dfc6377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:07.354374 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a574435-889e-492d-bcfe-ebb18dfc6377 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:07.374112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 508/996] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:07 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:10.522289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644e3e5-9e75-4c40-8343-e28fc85956c8 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:10.522949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644e3e5-9e75-4c40-8343-e28fc85956c8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:10.522949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644e3e5-9e75-4c40-8343-e28fc85956c8 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:10.524215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 489/997] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:10.530389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0e3d-29fb-4377-a4a5-78fd5229a8b9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:10.530897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0e3d-29fb-4377-a4a5-78fd5229a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:10.530984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0e3d-29fb-4377-a4a5-78fd5229a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:10.614031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b25f0e3d-29fb-4377-a4a5-78fd5229a8b9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:10.615269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b25f0e3d-29fb-4377-a4a5-78fd5229a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:10.726474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 509/998] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:11.030181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644e3e5-9e75-4c40-8343-e28fc85956c8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:11.034709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c644e3e5-9e75-4c40-8343-e28fc85956c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:11.100955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:11.171345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644e3e5-9e75-4c40-8343-e28fc85956c8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:11.254410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582bff9-c252-435f-892f-cc0cd428f36b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:11.255022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582bff9-c252-435f-892f-cc0cd428f36b service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:11.255287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582bff9-c252-435f-892f-cc0cd428f36b service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:11.255548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582bff9-c252-435f-892f-cc0cd428f36b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:11.257242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9582bff9-c252-435f-892f-cc0cd428f36b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:11.373367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:11.388483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582bff9-c252-435f-892f-cc0cd428f36b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:11.390082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582bff9-c252-435f-892f-cc0cd428f36b service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:11.410842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 490/999] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:14.412523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bcb10-16ca-4ee0-b1de-f5e80e74ec4e None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:14.413074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bcb10-16ca-4ee0-b1de-f5e80e74ec4e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:14.413074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0bcb10-16ca-4ee0-b1de-f5e80e74ec4e None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:14.414691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 510/1000] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:14.420354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf65a-162a-4ec6-898b-3b9100d51b32 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:14.420845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf65a-162a-4ec6-898b-3b9100d51b32 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:14.420938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbf65a-162a-4ec6-898b-3b9100d51b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:14.498281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d2bbf65a-162a-4ec6-898b-3b9100d51b32 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:14.499468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d2bbf65a-162a-4ec6-898b-3b9100d51b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:14.608326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 491/1001] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:14.893229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bcb10-16ca-4ee0-b1de-f5e80e74ec4e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:14.895433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fa0bcb10-16ca-4ee0-b1de-f5e80e74ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:14.916998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:15.014981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0bcb10-16ca-4ee0-b1de-f5e80e74ec4e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:15.108805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df56fd7-f72a-4c4c-b6d3-e74dc347c1fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:15.109427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56fd7-f72a-4c4c-b6d3-e74dc347c1fe service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:15.109712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56fd7-f72a-4c4c-b6d3-e74dc347c1fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:15.109973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56fd7-f72a-4c4c-b6d3-e74dc347c1fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:15.111591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7df56fd7-f72a-4c4c-b6d3-e74dc347c1fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:15.199731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:15.242198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df56fd7-f72a-4c4c-b6d3-e74dc347c1fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:15.243638 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df56fd7-f72a-4c4c-b6d3-e74dc347c1fe service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:15.266213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 511/1002] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:17.564934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9619f2-e3eb-4ff6-9e37-2d5a382e4e5f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:17.565726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9619f2-e3eb-4ff6-9e37-2d5a382e4e5f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:17.565726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9619f2-e3eb-4ff6-9e37-2d5a382e4e5f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:17.566955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 492/1003] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:17.573690 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c720-eaef-43a7-bd30-5c22ffda4d35 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:17.574279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c720-eaef-43a7-bd30-5c22ffda4d35 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:17.574279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5c720-eaef-43a7-bd30-5c22ffda4d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:17.651003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-19a5c720-eaef-43a7-bd30-5c22ffda4d35 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:17.652273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-19a5c720-eaef-43a7-bd30-5c22ffda4d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:17.775595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 512/1004] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:18.066536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9619f2-e3eb-4ff6-9e37-2d5a382e4e5f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:18.068333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8e9619f2-e3eb-4ff6-9e37-2d5a382e4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:18.145699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:18.209108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9619f2-e3eb-4ff6-9e37-2d5a382e4e5f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:18.334051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255002f4-ccb1-4e10-bc30-c4975c701c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:18.334690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255002f4-ccb1-4e10-bc30-c4975c701c09 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:18.335125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255002f4-ccb1-4e10-bc30-c4975c701c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:18.335392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255002f4-ccb1-4e10-bc30-c4975c701c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:18.337108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-255002f4-ccb1-4e10-bc30-c4975c701c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:18.482303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:18.486396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255002f4-ccb1-4e10-bc30-c4975c701c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:18.489024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255002f4-ccb1-4e10-bc30-c4975c701c09 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:18.513664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 493/1005] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:20.772405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2113631-843e-4c5b-a63e-84d5df716d70 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:20.773004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2113631-843e-4c5b-a63e-84d5df716d70 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:20.773004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2113631-843e-4c5b-a63e-84d5df716d70 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:20.774315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 513/1006] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:20.779720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41817278-dc67-4b44-842d-be1b56c01141 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:20.780186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41817278-dc67-4b44-842d-be1b56c01141 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:20.780291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41817278-dc67-4b44-842d-be1b56c01141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:20.856810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-41817278-dc67-4b44-842d-be1b56c01141 None None] MFA Rules not processed for user `1f7211cec2b84394b2a5f0d2d69692c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:20.858048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-41817278-dc67-4b44-842d-be1b56c01141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:20.960659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 494/1007] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:21.244282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2113631-843e-4c5b-a63e-84d5df716d70 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:21.245883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c2113631-843e-4c5b-a63e-84d5df716d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:21.286140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:21.373292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2113631-843e-4c5b-a63e-84d5df716d70 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:21.453107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434a505-8373-4e81-8be0-37cbf0173752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:21.453835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a505-8373-4e81-8be0-37cbf0173752 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:21.454015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a505-8373-4e81-8be0-37cbf0173752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:21.454317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434a505-8373-4e81-8be0-37cbf0173752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:21.455941 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e434a505-8373-4e81-8be0-37cbf0173752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:21.539922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:21.576714 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434a505-8373-4e81-8be0-37cbf0173752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:21.578303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434a505-8373-4e81-8be0-37cbf0173752 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:21.598759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 514/1008] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:21 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:24.059938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033cdb1-3210-4a33-9079-3521b8e8a96b None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:24.060535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033cdb1-3210-4a33-9079-3521b8e8a96b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:24.060535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033cdb1-3210-4a33-9079-3521b8e8a96b None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:24.061862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 495/1009] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:24.068014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2557-30e4-4879-b1b5-e8fe0967c832 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:24.068530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2557-30e4-4879-b1b5-e8fe0967c832 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:24.068638 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c2557-30e4-4879-b1b5-e8fe0967c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:24.142412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5b9c2557-30e4-4879-b1b5-e8fe0967c832 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:24.143651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5b9c2557-30e4-4879-b1b5-e8fe0967c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:24.273881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 515/1010] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:24.559288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033cdb1-3210-4a33-9079-3521b8e8a96b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:24.560836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4033cdb1-3210-4a33-9079-3521b8e8a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:24.641847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:24.679171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033cdb1-3210-4a33-9079-3521b8e8a96b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:24.759640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da3b56-6326-4e0e-82f0-b38968eb7a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:24.760253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da3b56-6326-4e0e-82f0-b38968eb7a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:24.760531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da3b56-6326-4e0e-82f0-b38968eb7a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:24.760799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da3b56-6326-4e0e-82f0-b38968eb7a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:24.762456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-82da3b56-6326-4e0e-82f0-b38968eb7a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:24.880390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da3b56-6326-4e0e-82f0-b38968eb7a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:24.881881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da3b56-6326-4e0e-82f0-b38968eb7a93 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:24.893360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:24.902435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 496/1011] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:27.244084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adfd6f-fbdb-4ec7-a42d-57bd237291c8 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:27.244783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adfd6f-fbdb-4ec7-a42d-57bd237291c8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:27.244783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adfd6f-fbdb-4ec7-a42d-57bd237291c8 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:27.246011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 516/1012] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:27.251847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56528e2-4abc-4f7a-a15a-b4d0bf976364 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:27.252688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56528e2-4abc-4f7a-a15a-b4d0bf976364 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:27.252688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56528e2-4abc-4f7a-a15a-b4d0bf976364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:27.325135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e56528e2-4abc-4f7a-a15a-b4d0bf976364 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:27.326383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e56528e2-4abc-4f7a-a15a-b4d0bf976364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:27.428957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 497/1013] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:27.712384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adfd6f-fbdb-4ec7-a42d-57bd237291c8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:27.713981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-58adfd6f-fbdb-4ec7-a42d-57bd237291c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:27.759440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:27.829313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adfd6f-fbdb-4ec7-a42d-57bd237291c8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:27.926332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189dabe-c3da-43d5-9f45-c5959bceeaa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:27.926968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189dabe-c3da-43d5-9f45-c5959bceeaa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:27.927250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189dabe-c3da-43d5-9f45-c5959bceeaa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:27.927522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189dabe-c3da-43d5-9f45-c5959bceeaa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:27.929215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7189dabe-c3da-43d5-9f45-c5959bceeaa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:28.028738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:28.058202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189dabe-c3da-43d5-9f45-c5959bceeaa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:28.059742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189dabe-c3da-43d5-9f45-c5959bceeaa5 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:28.080413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 517/1014] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:30.991807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd24f-93a2-4789-a536-c981aa228c7e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:30.992330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd24f-93a2-4789-a536-c981aa228c7e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:30.992330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9dd24f-93a2-4789-a536-c981aa228c7e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:30.993638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 498/1015] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:30.999536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4419ae-0249-482e-be8c-f8c73a10d38f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:31.000117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4419ae-0249-482e-be8c-f8c73a10d38f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:31.000117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4419ae-0249-482e-be8c-f8c73a10d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:31.079675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ef4419ae-0249-482e-be8c-f8c73a10d38f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:31.081616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ef4419ae-0249-482e-be8c-f8c73a10d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:31.195102 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 518/1016] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:31.476802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dd24f-93a2-4789-a536-c981aa228c7e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:31.478372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dd9dd24f-93a2-4789-a536-c981aa228c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:31.568291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:31.598978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9dd24f-93a2-4789-a536-c981aa228c7e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:31.680463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b4825-f4a5-4b8c-b5b1-e9195d666c50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:31.681073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b4825-f4a5-4b8c-b5b1-e9195d666c50 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:31.681353 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b4825-f4a5-4b8c-b5b1-e9195d666c50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:31.681659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b4825-f4a5-4b8c-b5b1-e9195d666c50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:31.683273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d48b4825-f4a5-4b8c-b5b1-e9195d666c50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:31.833157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b4825-f4a5-4b8c-b5b1-e9195d666c50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:31.834554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b4825-f4a5-4b8c-b5b1-e9195d666c50 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:31.855264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 499/1017] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:36.168532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f88e3-6f6c-495c-96f9-0df10801524b None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:36.169104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f88e3-6f6c-495c-96f9-0df10801524b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:36.169104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f88e3-6f6c-495c-96f9-0df10801524b None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:36.170492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 519/1018] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:36.177414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5b34-e0c2-4744-bb45-b89365f6af6b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:36.177996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5b34-e0c2-4744-bb45-b89365f6af6b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:36.178391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5b34-e0c2-4744-bb45-b89365f6af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:36.187404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:36.261155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9fbf5b34-e0c2-4744-bb45-b89365f6af6b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:36.262502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9fbf5b34-e0c2-4744-bb45-b89365f6af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:36.374352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 500/1019] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:36.657313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f88e3-6f6c-495c-96f9-0df10801524b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:36.658949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5c7f88e3-6f6c-495c-96f9-0df10801524b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:36.732586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:36.796256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f88e3-6f6c-495c-96f9-0df10801524b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:36.884849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108d15a-80bb-4556-a46e-78436dc94379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:36.885493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108d15a-80bb-4556-a46e-78436dc94379 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:36.885780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108d15a-80bb-4556-a46e-78436dc94379 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:36.886048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108d15a-80bb-4556-a46e-78436dc94379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:36.887740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b108d15a-80bb-4556-a46e-78436dc94379 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:36.994898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:37.015231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108d15a-80bb-4556-a46e-78436dc94379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:37.016729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108d15a-80bb-4556-a46e-78436dc94379 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:37.040448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 520/1020] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:39.998476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f1644-0565-4cc5-8012-834ef73abfdc None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:39.999081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f1644-0565-4cc5-8012-834ef73abfdc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:39.999081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f1644-0565-4cc5-8012-834ef73abfdc None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:40.000403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 501/1021] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:40.007356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cfd1-7a4e-435d-ac27-34cf9607223b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:40.007886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cfd1-7a4e-435d-ac27-34cf9607223b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:40.007886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760cfd1-7a4e-435d-ac27-34cf9607223b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:40.082900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5760cfd1-7a4e-435d-ac27-34cf9607223b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:40.084197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5760cfd1-7a4e-435d-ac27-34cf9607223b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:40.198209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 521/1022] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:40.483433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f1644-0565-4cc5-8012-834ef73abfdc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:40.484997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-611f1644-0565-4cc5-8012-834ef73abfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:40.590474 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:40.610292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f1644-0565-4cc5-8012-834ef73abfdc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:40.692999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5a9d3-e4f6-4f2a-9fda-e9512d352b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:40.693544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a9d3-e4f6-4f2a-9fda-e9512d352b7e service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:40.693831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a9d3-e4f6-4f2a-9fda-e9512d352b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:40.694147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a9d3-e4f6-4f2a-9fda-e9512d352b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:40.695713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2cb5a9d3-e4f6-4f2a-9fda-e9512d352b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:40.836089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5a9d3-e4f6-4f2a-9fda-e9512d352b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:40.837575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5a9d3-e4f6-4f2a-9fda-e9512d352b7e service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:40.857323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 502/1023] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:45.352747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191250d-137b-4e07-a9b7-38147493e824 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:45.353317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191250d-137b-4e07-a9b7-38147493e824 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:45.353317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191250d-137b-4e07-a9b7-38147493e824 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:45.354760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 522/1024] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:45.361761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06397731-b5a8-4039-b817-e36d666f387a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:45.362350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06397731-b5a8-4039-b817-e36d666f387a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:45.362721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06397731-b5a8-4039-b817-e36d666f387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:45.385275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:45.449663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-06397731-b5a8-4039-b817-e36d666f387a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:45.450888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-06397731-b5a8-4039-b817-e36d666f387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:45.566871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 503/1025] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:45.852639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191250d-137b-4e07-a9b7-38147493e824 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:49:45.854266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a191250d-137b-4e07-a9b7-38147493e824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:45.932247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:46.004116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191250d-137b-4e07-a9b7-38147493e824 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:49:46.097420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a121c88-d781-40b3-b05d-209bb1061d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:49:46.098022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121c88-d781-40b3-b05d-209bb1061d25 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:46.098300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121c88-d781-40b3-b05d-209bb1061d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:46.098568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121c88-d781-40b3-b05d-209bb1061d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:46.100192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0a121c88-d781-40b3-b05d-209bb1061d25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:46.236022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:46.240728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a121c88-d781-40b3-b05d-209bb1061d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:49:46.242328 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a121c88-d781-40b3-b05d-209bb1061d25 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:49:46.264200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 523/1026] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:49:51.436190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242039ef-0453-41f4-8efa-8f3c95c7d6cc None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:51.436897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242039ef-0453-41f4-8efa-8f3c95c7d6cc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:51.436897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242039ef-0453-41f4-8efa-8f3c95c7d6cc None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:51.441168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 504/1027] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 19:49:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:51.449061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47147-908d-436b-8780-851ff7460499 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:51.449494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47147-908d-436b-8780-851ff7460499 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:51.449581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47147-908d-436b-8780-851ff7460499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:51.561025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-23b47147-908d-436b-8780-851ff7460499 None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:51.563446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-23b47147-908d-436b-8780-851ff7460499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:51.716731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 524/1028] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 19:49:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:49:55.564951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=59 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:56.360340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155775-70a5-496c-ada3-ea28f1c81bce None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:56.360340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155775-70a5-496c-ada3-ea28f1c81bce None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:56.360340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155775-70a5-496c-ada3-ea28f1c81bce None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:56.362094 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 505/1029] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 19:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:56.367685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830d268-176c-48e2-b724-188e13a11d45 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:56.368361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830d268-176c-48e2-b724-188e13a11d45 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:56.368361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830d268-176c-48e2-b724-188e13a11d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:56.446425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:56.473984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4830d268-176c-48e2-b724-188e13a11d45 None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:56.475217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4830d268-176c-48e2-b724-188e13a11d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:56.637711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 525/1030] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 19:49:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:49:57.973929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d666-6980-4d2f-af21-8e2b11c70d23 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:57.974532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d666-6980-4d2f-af21-8e2b11c70d23 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:57.974532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d666-6980-4d2f-af21-8e2b11c70d23 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:57.975868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 506/1031] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 19:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:49:57.981331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa95f6-2946-49fe-979e-64d627d20c53 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:49:57.981840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa95f6-2946-49fe-979e-64d627d20c53 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:49:57.981957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa95f6-2946-49fe-979e-64d627d20c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:49:58.065254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b7fa95f6-2946-49fe-979e-64d627d20c53 None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:49:58.066591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b7fa95f6-2946-49fe-979e-64d627d20c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:49:58.115686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:49:58.220830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 526/1032] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:50:01.976802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be7b4a-f206-462d-8e0f-b5c4cd1dd500 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:01.977362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be7b4a-f206-462d-8e0f-b5c4cd1dd500 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:01.977362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be7b4a-f206-462d-8e0f-b5c4cd1dd500 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:01.978733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 507/1033] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:01.986125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ac4a-bea7-49c2-8c32-ae5e4a267e3d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:01.986921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ac4a-bea7-49c2-8c32-ae5e4a267e3d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:01.987319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9ac4a-bea7-49c2-8c32-ae5e4a267e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:02.077863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-82e9ac4a-bea7-49c2-8c32-ae5e4a267e3d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:02.079579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-82e9ac4a-bea7-49c2-8c32-ae5e4a267e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:02.247996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 527/1034] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:02.562536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465bbb9-6ec1-4e1c-a309-005a924460be None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:02.563170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465bbb9-6ec1-4e1c-a309-005a924460be None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:02.563834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465bbb9-6ec1-4e1c-a309-005a924460be None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:02.566039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 508/1035] 10.222.0.52 () {54 vars in 961 bytes} [Fri Oct 28 19:50:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:02.575485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27e860-0123-4595-a09f-9fa221e06141 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:02.576202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27e860-0123-4595-a09f-9fa221e06141 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:02.577115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f27e860-0123-4595-a09f-9fa221e06141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:02.598049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:02.676181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6f27e860-0123-4595-a09f-9fa221e06141 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:02.677851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6f27e860-0123-4595-a09f-9fa221e06141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:02.826073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 528/1036] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Oct 28 19:50:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:02.842560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465bbb9-6ec1-4e1c-a309-005a924460be None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:02.844622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3465bbb9-6ec1-4e1c-a309-005a924460be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:03.014568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3465bbb9-6ec1-4e1c-a309-005a924460be None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:03.097522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:03.146307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825686f-dda8-489b-b9fd-88bb2f2de2b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:03.147202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825686f-dda8-489b-b9fd-88bb2f2de2b1 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:03.147584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825686f-dda8-489b-b9fd-88bb2f2de2b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:03.147951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825686f-dda8-489b-b9fd-88bb2f2de2b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:03.149711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3825686f-dda8-489b-b9fd-88bb2f2de2b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:03.306732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825686f-dda8-489b-b9fd-88bb2f2de2b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:03.308558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825686f-dda8-489b-b9fd-88bb2f2de2b1 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:03.333578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 509/1037] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:50:05.855539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dfe08-17be-4910-8015-82824f556a49 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:05.856256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dfe08-17be-4910-8015-82824f556a49 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:05.856256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dfe08-17be-4910-8015-82824f556a49 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:05.857779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 529/1038] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:05.863547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef7b2-ed13-42a7-9c41-5f6cc442a2c6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:05.864032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef7b2-ed13-42a7-9c41-5f6cc442a2c6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:05.864141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef7b2-ed13-42a7-9c41-5f6cc442a2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:05.986197 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6c7ef7b2-ed13-42a7-9c41-5f6cc442a2c6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:05.987377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6c7ef7b2-ed13-42a7-9c41-5f6cc442a2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:06.045573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:06.124084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 510/1039] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:06.419908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15dfe08-17be-4910-8015-82824f556a49 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:06.422620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f15dfe08-17be-4910-8015-82824f556a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:06.502935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:06.638042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15dfe08-17be-4910-8015-82824f556a49 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:06.788300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d7a4-e5eb-4ad8-8f6a-4c2b64eaa9f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:06.788928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d7a4-e5eb-4ad8-8f6a-4c2b64eaa9f2 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:06.789201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d7a4-e5eb-4ad8-8f6a-4c2b64eaa9f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:06.789523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d7a4-e5eb-4ad8-8f6a-4c2b64eaa9f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:06.791202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8413d7a4-e5eb-4ad8-8f6a-4c2b64eaa9f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:06.817278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:06.896438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413d7a4-e5eb-4ad8-8f6a-4c2b64eaa9f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:06.898307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413d7a4-e5eb-4ad8-8f6a-4c2b64eaa9f2 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:06.920057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 530/1040] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:09.727557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f7d0-a6b5-4127-ad93-e1636d8ab18d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:09.728162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f7d0-a6b5-4127-ad93-e1636d8ab18d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:09.728602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9f7d0-a6b5-4127-ad93-e1636d8ab18d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:09.731456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 511/1041] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:09.741032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777decf-5be7-4de0-9197-d39c5707100c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:09.742034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777decf-5be7-4de0-9197-d39c5707100c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:09.742483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777decf-5be7-4de0-9197-d39c5707100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:09.836061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6777decf-5be7-4de0-9197-d39c5707100c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:09.843038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6777decf-5be7-4de0-9197-d39c5707100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:09.979680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:09.983730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 531/1042] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:10.273653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44a52-eab3-448e-af1c-f0aaf2880a3a None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:10.274023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44a52-eab3-448e-af1c-f0aaf2880a3a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:10.274228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e44a52-eab3-448e-af1c-f0aaf2880a3a None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:10.275833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 512/1043] 10.222.0.52 () {54 vars in 961 bytes} [Fri Oct 28 19:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:10.283480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc319a26-6d64-45be-a862-80af1e115067 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:10.284195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc319a26-6d64-45be-a862-80af1e115067 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:10.284872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc319a26-6d64-45be-a862-80af1e115067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:10.387872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-dc319a26-6d64-45be-a862-80af1e115067 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:10.389013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dc319a26-6d64-45be-a862-80af1e115067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:10.552588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 532/1044] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Oct 28 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:50:10.564741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e44a52-eab3-448e-af1c-f0aaf2880a3a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:10.567826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-40e44a52-eab3-448e-af1c-f0aaf2880a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:10.787524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e44a52-eab3-448e-af1c-f0aaf2880a3a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:10.811311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:10.811501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284535e-32db-4f49-8f77-961df272c501 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:10.811947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284535e-32db-4f49-8f77-961df272c501 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:10.811947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284535e-32db-4f49-8f77-961df272c501 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:10.813322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 533/1045] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:50:10.820291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631abe7b-256f-44cc-8f37-a19f13aa45c5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:10.821187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631abe7b-256f-44cc-8f37-a19f13aa45c5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:10.821187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631abe7b-256f-44cc-8f37-a19f13aa45c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:10.900793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:10.908035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-631abe7b-256f-44cc-8f37-a19f13aa45c5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:10.910148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-631abe7b-256f-44cc-8f37-a19f13aa45c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:10.932565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac061954-1af0-47c1-b6c8-276ba0de538e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:10.933215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061954-1af0-47c1-b6c8-276ba0de538e service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:10.933505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061954-1af0-47c1-b6c8-276ba0de538e service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:10.933764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac061954-1af0-47c1-b6c8-276ba0de538e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:10.935447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ac061954-1af0-47c1-b6c8-276ba0de538e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:11.040627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 534/1046] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:50:11.045236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac061954-1af0-47c1-b6c8-276ba0de538e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:11.047321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac061954-1af0-47c1-b6c8-276ba0de538e service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:11.070293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 513/1047] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:11.376906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e5e2-ba9a-4a62-b004-65ee0e7c3b92 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:11.377257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e5e2-ba9a-4a62-b004-65ee0e7c3b92 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:11.377687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915e5e2-ba9a-4a62-b004-65ee0e7c3b92 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:11.379188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 535/1048] 10.222.0.52 () {54 vars in 963 bytes} [Fri Oct 28 19:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:11.390000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20b12f-c333-4934-ad87-1a792a34f2d6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:11.390344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20b12f-c333-4934-ad87-1a792a34f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:11.390550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20b12f-c333-4934-ad87-1a792a34f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:11.437982 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:11.491390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1b20b12f-c333-4934-ad87-1a792a34f2d6 None None] MFA Rules not processed for user `e609d787cb964803b2630895f155a2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:11.492735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1b20b12f-c333-4934-ad87-1a792a34f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:11.585118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 514/1049] 10.222.0.52 () {58 vars in 1060 bytes} [Fri Oct 28 19:50:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:11.594053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e5e2-ba9a-4a62-b004-65ee0e7c3b92 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:11.596294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4915e5e2-ba9a-4a62-b004-65ee0e7c3b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:11.772435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915e5e2-ba9a-4a62-b004-65ee0e7c3b92 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:11.818242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:11.892219 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32382976-6ae3-4ea3-8cfd-72d39df20e29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:11.892858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382976-6ae3-4ea3-8cfd-72d39df20e29 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:11.893146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382976-6ae3-4ea3-8cfd-72d39df20e29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:11.893787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32382976-6ae3-4ea3-8cfd-72d39df20e29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:11.895226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-32382976-6ae3-4ea3-8cfd-72d39df20e29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:12.028926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32382976-6ae3-4ea3-8cfd-72d39df20e29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:12.030495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32382976-6ae3-4ea3-8cfd-72d39df20e29 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:12.056747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 536/1050] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:13.393330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174c65-785c-4ea7-a86f-5b233735f066 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:13.393940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174c65-785c-4ea7-a86f-5b233735f066 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:13.393940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77174c65-785c-4ea7-a86f-5b233735f066 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:13.395260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 515/1051] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:13.400631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b157-98a2-48dc-9b81-7c91e4535b8f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:13.401117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b157-98a2-48dc-9b81-7c91e4535b8f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:13.401117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33b157-98a2-48dc-9b81-7c91e4535b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:13.470956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-db33b157-98a2-48dc-9b81-7c91e4535b8f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:13.472267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-db33b157-98a2-48dc-9b81-7c91e4535b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:13.479905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:13.592369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 537/1052] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:13.880036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77174c65-785c-4ea7-a86f-5b233735f066 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:13.882042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-77174c65-785c-4ea7-a86f-5b233735f066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:14.010740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:14.051670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77174c65-785c-4ea7-a86f-5b233735f066 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:14.183180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319ecad-0a72-4d84-ba8d-33fd82bf0013 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:14.183792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ecad-0a72-4d84-ba8d-33fd82bf0013 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:14.184066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ecad-0a72-4d84-ba8d-33fd82bf0013 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:14.184342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319ecad-0a72-4d84-ba8d-33fd82bf0013 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:14.186332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9319ecad-0a72-4d84-ba8d-33fd82bf0013 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:14.292817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:14.307934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319ecad-0a72-4d84-ba8d-33fd82bf0013 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:14.311185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319ecad-0a72-4d84-ba8d-33fd82bf0013 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:14.341500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 516/1053] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:16.633672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba13677-e6d2-47ac-a050-d94cd85354e8 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:16.634309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba13677-e6d2-47ac-a050-d94cd85354e8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:16.634309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba13677-e6d2-47ac-a050-d94cd85354e8 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:16.635797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 538/1054] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:50:16.641453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765661-1f06-446a-832d-a454eecf7572 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:16.642196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765661-1f06-446a-832d-a454eecf7572 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:16.642196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765661-1f06-446a-832d-a454eecf7572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:16.726473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a8765661-1f06-446a-832d-a454eecf7572 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:16.727692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a8765661-1f06-446a-832d-a454eecf7572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:16.834426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 517/1055] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:50:17.129438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba13677-e6d2-47ac-a050-d94cd85354e8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:17.131335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fba13677-e6d2-47ac-a050-d94cd85354e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:17.285583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:17.300859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba13677-e6d2-47ac-a050-d94cd85354e8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:17.470705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27de95-116c-4a2a-bece-e5bac4535877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:17.471866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27de95-116c-4a2a-bece-e5bac4535877 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:17.472190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27de95-116c-4a2a-bece-e5bac4535877 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:17.472656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27de95-116c-4a2a-bece-e5bac4535877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:17.474579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ee27de95-116c-4a2a-bece-e5bac4535877 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:17.600525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27de95-116c-4a2a-bece-e5bac4535877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:17.602240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27de95-116c-4a2a-bece-e5bac4535877 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:17.614370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:17.624448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 539/1056] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:50:20.023505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04e9e-e35b-4811-b4f1-408c9081f77c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:20.024264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04e9e-e35b-4811-b4f1-408c9081f77c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:20.024486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04e9e-e35b-4811-b4f1-408c9081f77c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:20.026835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 518/1057] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:20.032726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c216da-3c73-4c83-924b-7c621ccc28aa None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:20.033640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c216da-3c73-4c83-924b-7c621ccc28aa None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:20.033928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c216da-3c73-4c83-924b-7c621ccc28aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:20.110249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-03c216da-3c73-4c83-924b-7c621ccc28aa None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:20.111436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-03c216da-3c73-4c83-924b-7c621ccc28aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:20.241799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 540/1058] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:20.640181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04e9e-e35b-4811-b4f1-408c9081f77c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:20.642202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fbb04e9e-e35b-4811-b4f1-408c9081f77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:20.730472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:20.883005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04e9e-e35b-4811-b4f1-408c9081f77c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:21.075758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81ebf5-5a9c-48fc-aa4b-6da5ebadf7aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:21.077272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ebf5-5a9c-48fc-aa4b-6da5ebadf7aa service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:21.077597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ebf5-5a9c-48fc-aa4b-6da5ebadf7aa service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:21.077893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81ebf5-5a9c-48fc-aa4b-6da5ebadf7aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:21.079632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-de81ebf5-5a9c-48fc-aa4b-6da5ebadf7aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:21.113049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:21.214176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81ebf5-5a9c-48fc-aa4b-6da5ebadf7aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:21.215847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81ebf5-5a9c-48fc-aa4b-6da5ebadf7aa service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:21.239631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 519/1059] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:24.382819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8fcb4-33ac-4b8b-a28f-615f3110d48f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:24.383889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8fcb4-33ac-4b8b-a28f-615f3110d48f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:24.384292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8fcb4-33ac-4b8b-a28f-615f3110d48f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:24.386141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 541/1060] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:24.394048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26d39-a785-4e54-8fa7-def0a8a8d5da None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:24.394710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26d39-a785-4e54-8fa7-def0a8a8d5da None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:24.395049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26d39-a785-4e54-8fa7-def0a8a8d5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:24.517840 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-60e26d39-a785-4e54-8fa7-def0a8a8d5da None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:24.519977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-60e26d39-a785-4e54-8fa7-def0a8a8d5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:24.697844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:24.711483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 520/1061] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:25.018920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8fcb4-33ac-4b8b-a28f-615f3110d48f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:25.020615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c8a8fcb4-33ac-4b8b-a28f-615f3110d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:25.130214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:25.266648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8fcb4-33ac-4b8b-a28f-615f3110d48f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:25.467605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b28c0-b0e6-403e-a15b-185f42545e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:25.468632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b28c0-b0e6-403e-a15b-185f42545e6f service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:25.468766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b28c0-b0e6-403e-a15b-185f42545e6f service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:25.469211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b28c0-b0e6-403e-a15b-185f42545e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:25.471869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e59b28c0-b0e6-403e-a15b-185f42545e6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:25.536543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:25.604815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b28c0-b0e6-403e-a15b-185f42545e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:25.606516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b28c0-b0e6-403e-a15b-185f42545e6f service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:25.629399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 542/1062] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:50:27.910709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a361848-c0cd-48d6-8086-4a4019c279bd None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:27.911358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a361848-c0cd-48d6-8086-4a4019c279bd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:27.911358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a361848-c0cd-48d6-8086-4a4019c279bd None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:27.912860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 521/1063] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:27.919843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e108be-8ec0-44d3-8305-4b69856f2fc3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:27.920443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e108be-8ec0-44d3-8305-4b69856f2fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:27.920721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e108be-8ec0-44d3-8305-4b69856f2fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:27.948602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9f25-7af9-4b0a-accb-e7501e47d7f3 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:27.948847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9f25-7af9-4b0a-accb-e7501e47d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:27.949099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a9f25-7af9-4b0a-accb-e7501e47d7f3 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:27.950517 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 522/1064] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:50:27.956591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889389d2-e693-451d-bebc-5c8ffa651ffd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:27.956904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889389d2-e693-451d-bebc-5c8ffa651ffd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:27.957144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889389d2-e693-451d-bebc-5c8ffa651ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.006174 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-53e108be-8ec0-44d3-8305-4b69856f2fc3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:28.007778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-53e108be-8ec0-44d3-8305-4b69856f2fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:28.040103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-889389d2-e693-451d-bebc-5c8ffa651ffd None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:28.041359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-889389d2-e693-451d-bebc-5c8ffa651ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:28.121781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 543/1065] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:28.159239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 523/1066] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:50:28.435950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fe1fb-c5ca-43d3-a32e-583b4dfe8076 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:28.436419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fe1fb-c5ca-43d3-a32e-583b4dfe8076 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:28.436877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55fe1fb-c5ca-43d3-a32e-583b4dfe8076 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.438995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 544/1067] 10.222.0.52 () {54 vars in 962 bytes} [Fri Oct 28 19:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:28.449527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993019-25f4-4acd-a6c5-157a3cc973a3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:28.450036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993019-25f4-4acd-a6c5-157a3cc973a3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:28.450508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993019-25f4-4acd-a6c5-157a3cc973a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.455997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fe1fb-c5ca-43d3-a32e-583b4dfe8076 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:28.457611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d55fe1fb-c5ca-43d3-a32e-583b4dfe8076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:28.472107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:28.563053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e4993019-25f4-4acd-a6c5-157a3cc973a3 None None] MFA Rules not processed for user `237bbe3771c249449b4c2cad20fa5ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:28.564289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e4993019-25f4-4acd-a6c5-157a3cc973a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:28.585692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:28.656086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 524/1068] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Oct 28 19:50:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:28.666174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993019-25f4-4acd-a6c5-157a3cc973a3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:28.678897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993019-25f4-4acd-a6c5-157a3cc973a3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:28.682263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55fe1fb-c5ca-43d3-a32e-583b4dfe8076 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:28.794844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770b649-21bf-4b58-8dad-5ac9822e0c10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:28.795573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b649-21bf-4b58-8dad-5ac9822e0c10 service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:28.795917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b649-21bf-4b58-8dad-5ac9822e0c10 service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:28.796252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770b649-21bf-4b58-8dad-5ac9822e0c10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.798278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1770b649-21bf-4b58-8dad-5ac9822e0c10 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:28.813271 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:28.847100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f841ca-b049-4d12-ac04-e889ecb04854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:28.847722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f841ca-b049-4d12-ac04-e889ecb04854 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:28.847988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f841ca-b049-4d12-ac04-e889ecb04854 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:28.848252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f841ca-b049-4d12-ac04-e889ecb04854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:28.849946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b7f841ca-b049-4d12-ac04-e889ecb04854 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:28.932295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:28.974556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f841ca-b049-4d12-ac04-e889ecb04854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:28.976727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f841ca-b049-4d12-ac04-e889ecb04854 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:28.977692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770b649-21bf-4b58-8dad-5ac9822e0c10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:28.979302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770b649-21bf-4b58-8dad-5ac9822e0c10 service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:29.001291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 545/1069] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:50:29.003745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 525/1070] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:50:29.898126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203ee4-872f-4609-9d08-6adb43a32409 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:29.898490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203ee4-872f-4609-9d08-6adb43a32409 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:29.898759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5203ee4-872f-4609-9d08-6adb43a32409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:30.014475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d5203ee4-872f-4609-9d08-6adb43a32409 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:30.016453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d5203ee4-872f-4609-9d08-6adb43a32409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:30.107621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:30.171325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 546/1071] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 19:50:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:30.230553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f69cb-7e8f-4a78-9625-03e1d9638a07 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:30.231327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f69cb-7e8f-4a78-9625-03e1d9638a07 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:30.231615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f69cb-7e8f-4a78-9625-03e1d9638a07 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:30.234186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 526/1072] 10.222.0.52 () {54 vars in 943 bytes} [Fri Oct 28 19:50:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:30.243662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8579-3820-4157-9626-bb9c1772ac61 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:30.244247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8579-3820-4157-9626-bb9c1772ac61 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:30.244763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0a8579-3820-4157-9626-bb9c1772ac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:30.349200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7a0a8579-3820-4157-9626-bb9c1772ac61 None None] MFA Rules not processed for user `5eb5a6ff4af64a9980bcaa49f3c97bba`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:30.350493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7a0a8579-3820-4157-9626-bb9c1772ac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:30.493567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 547/1073] 10.222.0.52 () {58 vars in 1040 bytes} [Fri Oct 28 19:50:30 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:30.505236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f69cb-7e8f-4a78-9625-03e1d9638a07 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:30.508547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-434f69cb-7e8f-4a78-9625-03e1d9638a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:30.687678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f69cb-7e8f-4a78-9625-03e1d9638a07 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:30.765066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:30.820243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec5482-eb01-492e-94a4-0672a04b23dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:30.820866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec5482-eb01-492e-94a4-0672a04b23dc service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:30.821141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec5482-eb01-492e-94a4-0672a04b23dc service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:30.821496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec5482-eb01-492e-94a4-0672a04b23dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:30.823157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f2ec5482-eb01-492e-94a4-0672a04b23dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:30.931691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec5482-eb01-492e-94a4-0672a04b23dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:30.933339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec5482-eb01-492e-94a4-0672a04b23dc service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:30.945286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 527/1074] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 19:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:50:31.397257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bdcc8-0c2e-4f8d-b0eb-ce93cb58a7e7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:31.397820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bdcc8-0c2e-4f8d-b0eb-ce93cb58a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:31.397820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bdcc8-0c2e-4f8d-b0eb-ce93cb58a7e7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:31.399232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 548/1075] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:31.404811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef68e3-5601-466f-b1d8-8131a592ef0f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:31.405948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef68e3-5601-466f-b1d8-8131a592ef0f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:31.406211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef68e3-5601-466f-b1d8-8131a592ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:31.494079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-34ef68e3-5601-466f-b1d8-8131a592ef0f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:31.495309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-34ef68e3-5601-466f-b1d8-8131a592ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:31.544997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:31.624616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 528/1076] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:31.939508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bdcc8-0c2e-4f8d-b0eb-ce93cb58a7e7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:31.941061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-534bdcc8-0c2e-4f8d-b0eb-ce93cb58a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:31.967783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:32.139713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bdcc8-0c2e-4f8d-b0eb-ce93cb58a7e7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:32.308313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:32.328250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6467a9-0c45-4cc6-b886-6ac7de1b2f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:32.329231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6467a9-0c45-4cc6-b886-6ac7de1b2f4a service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:32.329769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6467a9-0c45-4cc6-b886-6ac7de1b2f4a service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:32.330206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6467a9-0c45-4cc6-b886-6ac7de1b2f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:32.332142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7b6467a9-0c45-4cc6-b886-6ac7de1b2f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:32.471653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6467a9-0c45-4cc6-b886-6ac7de1b2f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:32.474738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6467a9-0c45-4cc6-b886-6ac7de1b2f4a service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:32.509818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 549/1077] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:34.829260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4957e-d696-4ab1-a8c3-016fb997455c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:34.829964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4957e-d696-4ab1-a8c3-016fb997455c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:34.829964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4957e-d696-4ab1-a8c3-016fb997455c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:34.831378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 529/1078] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:34.842431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce669-91af-446e-b0ff-042f7c811a87 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:34.843059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce669-91af-446e-b0ff-042f7c811a87 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:34.843059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce669-91af-446e-b0ff-042f7c811a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:34.947140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-37fce669-91af-446e-b0ff-042f7c811a87 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:34.948820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-37fce669-91af-446e-b0ff-042f7c811a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:35.052023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:35.121512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 550/1079] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:35.416160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4957e-d696-4ab1-a8c3-016fb997455c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:35.417745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e0c4957e-d696-4ab1-a8c3-016fb997455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:35.596671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4957e-d696-4ab1-a8c3-016fb997455c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:35.631481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:35.744432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a208f4-e18a-4a6f-9652-db8280b2289c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:35.745053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a208f4-e18a-4a6f-9652-db8280b2289c service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:35.745328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a208f4-e18a-4a6f-9652-db8280b2289c service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:35.745657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a208f4-e18a-4a6f-9652-db8280b2289c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:35.747264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b5a208f4-e18a-4a6f-9652-db8280b2289c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:35.845728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a208f4-e18a-4a6f-9652-db8280b2289c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:35.847341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a208f4-e18a-4a6f-9652-db8280b2289c service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:35.867495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 530/1080] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:38.182451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa4b9d-b6d5-4f17-9c9f-8a54ba2034d4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:38.182914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa4b9d-b6d5-4f17-9c9f-8a54ba2034d4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:38.183168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa4b9d-b6d5-4f17-9c9f-8a54ba2034d4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:38.184426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 551/1081] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:38.200615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59daaf-dd68-4d8e-b628-99f28c899bf8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:38.201214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59daaf-dd68-4d8e-b628-99f28c899bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:38.201214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59daaf-dd68-4d8e-b628-99f28c899bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:38.247154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:38.283938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3f59daaf-dd68-4d8e-b628-99f28c899bf8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:38.285192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3f59daaf-dd68-4d8e-b628-99f28c899bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:38.416159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 531/1082] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:38.705659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa4b9d-b6d5-4f17-9c9f-8a54ba2034d4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:38.707639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-88aa4b9d-b6d5-4f17-9c9f-8a54ba2034d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:38.978284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa4b9d-b6d5-4f17-9c9f-8a54ba2034d4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:39.112953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:39.262333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a2082-7788-413d-977b-b7f144911f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:39.263426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a2082-7788-413d-977b-b7f144911f29 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:39.263906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a2082-7788-413d-977b-b7f144911f29 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:39.264365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a2082-7788-413d-977b-b7f144911f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:39.267308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ae5a2082-7788-413d-977b-b7f144911f29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:39.384843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a2082-7788-413d-977b-b7f144911f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:39.386743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5a2082-7788-413d-977b-b7f144911f29 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:39.409512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 552/1083] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:41.662751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812605-0621-4269-baf9-8c14c1042e6f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:41.662751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812605-0621-4269-baf9-8c14c1042e6f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:41.662751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812605-0621-4269-baf9-8c14c1042e6f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:41.662751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 532/1084] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:41.667193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839146-6957-439e-88cd-182ea383a8c9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:41.667755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839146-6957-439e-88cd-182ea383a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:41.667755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839146-6957-439e-88cd-182ea383a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:41.745745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:41.754695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-48839146-6957-439e-88cd-182ea383a8c9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:41.755943 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-48839146-6957-439e-88cd-182ea383a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:41.884966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 553/1085] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:42.179290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812605-0621-4269-baf9-8c14c1042e6f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:42.181324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e1812605-0621-4269-baf9-8c14c1042e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:42.334598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:42.389967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812605-0621-4269-baf9-8c14c1042e6f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:42.593522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66bdbca-e6e6-4d69-ab32-6b4d9bff8b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:42.594138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bdbca-e6e6-4d69-ab32-6b4d9bff8b85 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:42.594412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bdbca-e6e6-4d69-ab32-6b4d9bff8b85 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:42.594679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66bdbca-e6e6-4d69-ab32-6b4d9bff8b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:42.596347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a66bdbca-e6e6-4d69-ab32-6b4d9bff8b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:42.693207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:42.722202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bdbca-e6e6-4d69-ab32-6b4d9bff8b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:42.725152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66bdbca-e6e6-4d69-ab32-6b4d9bff8b85 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:42.751684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 533/1086] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:51.882323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=44 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:52.749425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=14 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:54.241334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce2b0-50eb-407a-897c-dfa5d3f53f6f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:54.242352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce2b0-50eb-407a-897c-dfa5d3f53f6f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:54.242352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ce2b0-50eb-407a-897c-dfa5d3f53f6f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:54.243487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 554/1087] 10.222.0.52 () {54 vars in 918 bytes} [Fri Oct 28 19:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:54.249538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc04a-3fbb-49ae-9558-3270315cfa28 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:54.250091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc04a-3fbb-49ae-9558-3270315cfa28 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:54.250091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dc04a-3fbb-49ae-9558-3270315cfa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:54.338524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1b0dc04a-3fbb-49ae-9558-3270315cfa28 None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:54.339738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1b0dc04a-3fbb-49ae-9558-3270315cfa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:54.451473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 534/1088] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Oct 28 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:54.466812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd56f3-eb75-40d8-813d-0f5861fa030c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:54.467089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd56f3-eb75-40d8-813d-0f5861fa030c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:54.467356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd56f3-eb75-40d8-813d-0f5861fa030c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:54.468687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 555/1089] 10.222.0.52 () {54 vars in 918 bytes} [Fri Oct 28 19:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:54.473668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe961c-28cb-47e3-99fc-762484d74949 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:54.473949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe961c-28cb-47e3-99fc-762484d74949 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:54.474221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe961c-28cb-47e3-99fc-762484d74949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:54.553401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:54.556606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-abfe961c-28cb-47e3-99fc-762484d74949 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:54.558778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-abfe961c-28cb-47e3-99fc-762484d74949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:54.683114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 535/1090] 10.222.0.52 () {58 vars in 1015 bytes} [Fri Oct 28 19:50:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:57.339161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21c503-365f-474a-9d39-9c857a19fecb None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:57.339726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21c503-365f-474a-9d39-9c857a19fecb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:57.339726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21c503-365f-474a-9d39-9c857a19fecb None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:57.341047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 556/1091] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:57.346736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a98-4f27-49cf-9128-8faae747d935 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:57.347192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a98-4f27-49cf-9128-8faae747d935 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:57.347290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78325a98-4f27-49cf-9128-8faae747d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:57.420402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-78325a98-4f27-49cf-9128-8faae747d935 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:57.421863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-78325a98-4f27-49cf-9128-8faae747d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:57.479878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:57.536532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 536/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:57.825930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21c503-365f-474a-9d39-9c857a19fecb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:57.827474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9a21c503-365f-474a-9d39-9c857a19fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:57.999940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21c503-365f-474a-9d39-9c857a19fecb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:50:58.075631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:58.133887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe456c-1e8f-4362-b9fc-180b56d739e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:50:58.134505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe456c-1e8f-4362-b9fc-180b56d739e6 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:58.134857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe456c-1e8f-4362-b9fc-180b56d739e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:58.135137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe456c-1e8f-4362-b9fc-180b56d739e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:58.136804 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-95fe456c-1e8f-4362-b9fc-180b56d739e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:58.252248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe456c-1e8f-4362-b9fc-180b56d739e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:50:58.253909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe456c-1e8f-4362-b9fc-180b56d739e6 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:50:58.275505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 557/1093] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:50:59.430425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96a17-c85d-40ad-9cd9-203443c65e74 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:59.431052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96a17-c85d-40ad-9cd9-203443c65e74 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:59.431052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d96a17-c85d-40ad-9cd9-203443c65e74 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:59.432406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 537/1094] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:50:59.437913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5bf8-6ace-460c-9dd0-364579f3f12f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:50:59.438384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5bf8-6ace-460c-9dd0-364579f3f12f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:50:59.438488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5bf8-6ace-460c-9dd0-364579f3f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:50:59.520112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-118a5bf8-6ace-460c-9dd0-364579f3f12f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:50:59.521331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-118a5bf8-6ace-460c-9dd0-364579f3f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:59.550425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:50:59.627117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 558/1095] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:50:59.788026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96a17-c85d-40ad-9cd9-203443c65e74 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:50:59.789633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-91d96a17-c85d-40ad-9cd9-203443c65e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:50:59.964794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d96a17-c85d-40ad-9cd9-203443c65e74 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:00.011342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:00.089319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a71b0-e4e3-4204-8ce7-084f9231108f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:00.089879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a71b0-e4e3-4204-8ce7-084f9231108f service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:00.090156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a71b0-e4e3-4204-8ce7-084f9231108f service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:00.090426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a71b0-e4e3-4204-8ce7-084f9231108f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:00.092105 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-163a71b0-e4e3-4204-8ce7-084f9231108f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:00.202170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a71b0-e4e3-4204-8ce7-084f9231108f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:00.203806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a71b0-e4e3-4204-8ce7-084f9231108f service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:00.223950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 538/1096] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:01.351478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15707-db8c-4e6f-81c5-06d5d4e8fb26 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:01.352112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15707-db8c-4e6f-81c5-06d5d4e8fb26 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:01.352112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc15707-db8c-4e6f-81c5-06d5d4e8fb26 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:01.353513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 559/1097] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:01.359078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a407-64ca-4d10-b2b3-895bed41ace1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:01.359889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a407-64ca-4d10-b2b3-895bed41ace1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:01.360054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a407-64ca-4d10-b2b3-895bed41ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:01.418929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:01.444435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4a40a407-64ca-4d10-b2b3-895bed41ace1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:01.445717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4a40a407-64ca-4d10-b2b3-895bed41ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:01.551060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 539/1098] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:01.702832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15707-db8c-4e6f-81c5-06d5d4e8fb26 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:01.704355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dbc15707-db8c-4e6f-81c5-06d5d4e8fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:01.856593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc15707-db8c-4e6f-81c5-06d5d4e8fb26 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:01.869132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:01.983733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f8a8e-6a31-46a2-a4f3-14e6ba904764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:01.984338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f8a8e-6a31-46a2-a4f3-14e6ba904764 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:01.984611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f8a8e-6a31-46a2-a4f3-14e6ba904764 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:01.984916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f8a8e-6a31-46a2-a4f3-14e6ba904764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:01.986548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-642f8a8e-6a31-46a2-a4f3-14e6ba904764 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:02.090033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f8a8e-6a31-46a2-a4f3-14e6ba904764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:02.091641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f8a8e-6a31-46a2-a4f3-14e6ba904764 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:02.112538 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 560/1099] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:03.237139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7d7b-ce7c-4d50-99fb-064a94433ff9 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:03.237933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7d7b-ce7c-4d50-99fb-064a94433ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:03.237933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad7d7b-ce7c-4d50-99fb-064a94433ff9 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:03.239450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 540/1100] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:03.245621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbd05b-167d-4abf-b09c-8258a8fcec1a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:03.246167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbd05b-167d-4abf-b09c-8258a8fcec1a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:03.246167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbd05b-167d-4abf-b09c-8258a8fcec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:03.268117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:03.328210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-31bbd05b-167d-4abf-b09c-8258a8fcec1a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:03.329529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-31bbd05b-167d-4abf-b09c-8258a8fcec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:03.435548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 561/1101] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:03.586192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7d7b-ce7c-4d50-99fb-064a94433ff9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:03.588430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e6ad7d7b-ce7c-4d50-99fb-064a94433ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:03.726817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:03.765622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad7d7b-ce7c-4d50-99fb-064a94433ff9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:03.886797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4079e1-c614-43b2-9b90-765a3e309ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:03.887402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4079e1-c614-43b2-9b90-765a3e309ba6 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:03.887682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4079e1-c614-43b2-9b90-765a3e309ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:03.887955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4079e1-c614-43b2-9b90-765a3e309ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:03.889646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6b4079e1-c614-43b2-9b90-765a3e309ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:03.970124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:03.986043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4079e1-c614-43b2-9b90-765a3e309ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:03.987669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4079e1-c614-43b2-9b90-765a3e309ba6 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:04.007296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 541/1102] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:05.123185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1e62-2e3a-4c9e-97fb-763ac921db6f None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:05.123798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1e62-2e3a-4c9e-97fb-763ac921db6f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:05.123798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a1e62-2e3a-4c9e-97fb-763ac921db6f None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:05.125042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 562/1103] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:05.131364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba542a-55e2-45a7-b432-75041c7fcb29 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:05.132179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba542a-55e2-45a7-b432-75041c7fcb29 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:05.132338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba542a-55e2-45a7-b432-75041c7fcb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:05.222297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-91ba542a-55e2-45a7-b432-75041c7fcb29 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:05.223572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-91ba542a-55e2-45a7-b432-75041c7fcb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:05.331812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 542/1104] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:05.495077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1e62-2e3a-4c9e-97fb-763ac921db6f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:05.497446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-961a1e62-2e3a-4c9e-97fb-763ac921db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:05.603328 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:05.668317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a1e62-2e3a-4c9e-97fb-763ac921db6f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:05.788004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc48f51-7c8b-40cb-bb58-8fa661c743ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:05.788532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48f51-7c8b-40cb-bb58-8fa661c743ea service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:05.788810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48f51-7c8b-40cb-bb58-8fa661c743ea service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:05.789075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc48f51-7c8b-40cb-bb58-8fa661c743ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:05.790788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7cc48f51-7c8b-40cb-bb58-8fa661c743ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:05.846447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:05.908599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48f51-7c8b-40cb-bb58-8fa661c743ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:05.910288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc48f51-7c8b-40cb-bb58-8fa661c743ea service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:05.928895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 563/1105] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:06.992289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c1e89-3d61-48ae-a83a-ee3cd4535514 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:06.992855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c1e89-3d61-48ae-a83a-ee3cd4535514 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:06.992855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c1e89-3d61-48ae-a83a-ee3cd4535514 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:06.994248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 543/1106] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:07.000352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913302a-fe10-4481-9c7d-b0b55d6034fb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:07.001157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913302a-fe10-4481-9c7d-b0b55d6034fb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:07.001302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913302a-fe10-4481-9c7d-b0b55d6034fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:07.087626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0913302a-fe10-4481-9c7d-b0b55d6034fb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:07.088841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0913302a-fe10-4481-9c7d-b0b55d6034fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:07.202135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 564/1107] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:07.356653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c1e89-3d61-48ae-a83a-ee3cd4535514 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:07.359068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b42c1e89-3d61-48ae-a83a-ee3cd4535514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:07.418379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:07.528859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c1e89-3d61-48ae-a83a-ee3cd4535514 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:07.675453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f73b18-894c-448b-9e31-24e768ccde27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:07.676076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73b18-894c-448b-9e31-24e768ccde27 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:07.676370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73b18-894c-448b-9e31-24e768ccde27 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:07.676639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f73b18-894c-448b-9e31-24e768ccde27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:07.678367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-17f73b18-894c-448b-9e31-24e768ccde27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:07.686629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:07.778005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73b18-894c-448b-9e31-24e768ccde27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:07.779698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f73b18-894c-448b-9e31-24e768ccde27 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:07.797913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 544/1108] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:08.880475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9a0e-08f9-419b-b703-9392f097cf92 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:08.881080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9a0e-08f9-419b-b703-9392f097cf92 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:08.881080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9a0e-08f9-419b-b703-9392f097cf92 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:08.882441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 565/1109] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:08.888914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626829-5278-4b05-a886-636405167f34 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:08.889479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626829-5278-4b05-a886-636405167f34 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:08.889479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00626829-5278-4b05-a886-636405167f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:08.972609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-00626829-5278-4b05-a886-636405167f34 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:08.973874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-00626829-5278-4b05-a886-636405167f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:09.064156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:09.097650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 545/1110] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:51:09.253798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c9a0e-08f9-419b-b703-9392f097cf92 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:09.255895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8d2c9a0e-08f9-419b-b703-9392f097cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:09.282119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:09.429528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c9a0e-08f9-419b-b703-9392f097cf92 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:09.526045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:09.556928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202e553-25f8-466d-abda-26d7f01f9092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:09.557628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e553-25f8-466d-abda-26d7f01f9092 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:09.557911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e553-25f8-466d-abda-26d7f01f9092 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:09.558232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e553-25f8-466d-abda-26d7f01f9092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:09.560043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7202e553-25f8-466d-abda-26d7f01f9092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:09.661924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202e553-25f8-466d-abda-26d7f01f9092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:09.663732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202e553-25f8-466d-abda-26d7f01f9092 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:09.684717 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 566/1111] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:10.758719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973c1f-561f-4d52-908a-2ec504a3984d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:10.759721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973c1f-561f-4d52-908a-2ec504a3984d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:10.759721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973c1f-561f-4d52-908a-2ec504a3984d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:10.761060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 546/1112] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:10.766735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab80de-ef45-489c-88bd-bbff195d55e2 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:10.767190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab80de-ef45-489c-88bd-bbff195d55e2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:10.767290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab80de-ef45-489c-88bd-bbff195d55e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:10.859037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-09ab80de-ef45-489c-88bd-bbff195d55e2 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:10.860291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-09ab80de-ef45-489c-88bd-bbff195d55e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:10.906677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:10.988205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 567/1113] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:11.144201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973c1f-561f-4d52-908a-2ec504a3984d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:11.146457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f2973c1f-561f-4d52-908a-2ec504a3984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:11.309545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973c1f-561f-4d52-908a-2ec504a3984d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:11.372944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:11.444506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b93dad-c49a-4cd6-a336-876d92e7139d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:11.445177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b93dad-c49a-4cd6-a336-876d92e7139d service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:11.445483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b93dad-c49a-4cd6-a336-876d92e7139d service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:11.445747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b93dad-c49a-4cd6-a336-876d92e7139d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:11.447444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d5b93dad-c49a-4cd6-a336-876d92e7139d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:11.544873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b93dad-c49a-4cd6-a336-876d92e7139d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:11.546549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b93dad-c49a-4cd6-a336-876d92e7139d service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:11.564995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 547/1114] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:12.643126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62ee9-84d0-443f-b7dc-1e18ba9e76c6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:12.643893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62ee9-84d0-443f-b7dc-1e18ba9e76c6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:12.643893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c62ee9-84d0-443f-b7dc-1e18ba9e76c6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:12.645139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 568/1115] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:12.651135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476272eb-e703-4da9-ac99-66306ff6069b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:12.651724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476272eb-e703-4da9-ac99-66306ff6069b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:12.651724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476272eb-e703-4da9-ac99-66306ff6069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:12.746233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-476272eb-e703-4da9-ac99-66306ff6069b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:12.747487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-476272eb-e703-4da9-ac99-66306ff6069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:12.749794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:12.866914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 548/1116] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:13.030302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62ee9-84d0-443f-b7dc-1e18ba9e76c6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:13.031799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-10c62ee9-84d0-443f-b7dc-1e18ba9e76c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:13.204626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c62ee9-84d0-443f-b7dc-1e18ba9e76c6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:13.236152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:13.335089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d4371-6ff8-4e3f-846a-392ab7acbe4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:13.335612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d4371-6ff8-4e3f-846a-392ab7acbe4a service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:13.335885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d4371-6ff8-4e3f-846a-392ab7acbe4a service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:13.336154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d4371-6ff8-4e3f-846a-392ab7acbe4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:13.337843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bb5d4371-6ff8-4e3f-846a-392ab7acbe4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:13.438111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d4371-6ff8-4e3f-846a-392ab7acbe4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:13.439737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d4371-6ff8-4e3f-846a-392ab7acbe4a service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:13.458437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 569/1117] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:15.581300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117758f-cf35-4fd6-abd9-d361cf52783f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:15.581992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117758f-cf35-4fd6-abd9-d361cf52783f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:15.581992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117758f-cf35-4fd6-abd9-d361cf52783f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:15.583241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 549/1118] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:15.589147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7b31-a5b3-4bb5-ba65-a6055102a7ba None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:15.589674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7b31-a5b3-4bb5-ba65-a6055102a7ba None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:15.589783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf7b31-a5b3-4bb5-ba65-a6055102a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:15.632982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:15.662982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-22cf7b31-a5b3-4bb5-ba65-a6055102a7ba None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:15.664221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-22cf7b31-a5b3-4bb5-ba65-a6055102a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:15.779079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 570/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:16.063701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117758f-cf35-4fd6-abd9-d361cf52783f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:16.065331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0117758f-cf35-4fd6-abd9-d361cf52783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:16.178744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117758f-cf35-4fd6-abd9-d361cf52783f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:16.222568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:16.269846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab15b97-a3d6-41f1-8cd1-2b0f20ae6171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:16.270474 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15b97-a3d6-41f1-8cd1-2b0f20ae6171 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:16.270753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15b97-a3d6-41f1-8cd1-2b0f20ae6171 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:16.271025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab15b97-a3d6-41f1-8cd1-2b0f20ae6171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:16.272773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1ab15b97-a3d6-41f1-8cd1-2b0f20ae6171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:16.394860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab15b97-a3d6-41f1-8cd1-2b0f20ae6171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:16.396314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab15b97-a3d6-41f1-8cd1-2b0f20ae6171 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:16.415027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 550/1120] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:18.733182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16845-b49b-4a50-bc43-70869703771a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:18.733810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16845-b49b-4a50-bc43-70869703771a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:18.733810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc16845-b49b-4a50-bc43-70869703771a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:18.735287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 571/1121] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:18.741843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81b1b-69f5-43d9-9a8a-9e7269e63dd8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:18.742539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81b1b-69f5-43d9-9a8a-9e7269e63dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:18.742539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81b1b-69f5-43d9-9a8a-9e7269e63dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:18.839540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-faa81b1b-69f5-43d9-9a8a-9e7269e63dd8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:18.840813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-faa81b1b-69f5-43d9-9a8a-9e7269e63dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:18.855664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:18.946572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 551/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:19.233257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16845-b49b-4a50-bc43-70869703771a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:19.234903 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1dc16845-b49b-4a50-bc43-70869703771a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:19.343202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc16845-b49b-4a50-bc43-70869703771a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:19.357346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:19.422210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede16d8-d7b6-4668-aa62-d4780d4d40aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:19.422827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede16d8-d7b6-4668-aa62-d4780d4d40aa service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:19.423103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede16d8-d7b6-4668-aa62-d4780d4d40aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:19.423382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede16d8-d7b6-4668-aa62-d4780d4d40aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:19.425030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-eede16d8-d7b6-4668-aa62-d4780d4d40aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:19.535613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede16d8-d7b6-4668-aa62-d4780d4d40aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:19.536985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede16d8-d7b6-4668-aa62-d4780d4d40aa service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:19.556080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 572/1123] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:51:22.119328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad6ffd-cc81-417f-9d2d-1957e5a2ab7f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:22.119879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad6ffd-cc81-417f-9d2d-1957e5a2ab7f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:22.119879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad6ffd-cc81-417f-9d2d-1957e5a2ab7f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:22.121228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 552/1124] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:22.126841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3288f4-72a9-480a-a594-468414b0fb5a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:22.127408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3288f4-72a9-480a-a594-468414b0fb5a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:22.127408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3288f4-72a9-480a-a594-468414b0fb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:22.183216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:22.205540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bb3288f4-72a9-480a-a594-468414b0fb5a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:22.206846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bb3288f4-72a9-480a-a594-468414b0fb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:22.314985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 573/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:22.601830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad6ffd-cc81-417f-9d2d-1957e5a2ab7f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:22.603407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0aad6ffd-cc81-417f-9d2d-1957e5a2ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:22.727342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad6ffd-cc81-417f-9d2d-1957e5a2ab7f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:22.770812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:22.806542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da16d4-4dff-4b14-84b6-13e9e0c5e312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:22.807173 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da16d4-4dff-4b14-84b6-13e9e0c5e312 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:22.807447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da16d4-4dff-4b14-84b6-13e9e0c5e312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:22.807717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da16d4-4dff-4b14-84b6-13e9e0c5e312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:22.809347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-22da16d4-4dff-4b14-84b6-13e9e0c5e312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:22.936580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da16d4-4dff-4b14-84b6-13e9e0c5e312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:22.938056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da16d4-4dff-4b14-84b6-13e9e0c5e312 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:22.956921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 553/1126] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:25.418371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933b48-a733-42af-8c62-f01be367eb66 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:25.419452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933b48-a733-42af-8c62-f01be367eb66 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:25.419452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d933b48-a733-42af-8c62-f01be367eb66 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:25.420738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 574/1127] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:25.427990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88759-0a30-421b-9ab0-4fbc03fb03cf None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:25.428593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88759-0a30-421b-9ab0-4fbc03fb03cf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:25.428593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88759-0a30-421b-9ab0-4fbc03fb03cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:25.528033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-16c88759-0a30-421b-9ab0-4fbc03fb03cf None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:25.529963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-16c88759-0a30-421b-9ab0-4fbc03fb03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:25.565291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:25.681085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 554/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:25.974631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d933b48-a733-42af-8c62-f01be367eb66 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:25.976283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6d933b48-a733-42af-8c62-f01be367eb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:26.120282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d933b48-a733-42af-8c62-f01be367eb66 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:26.148121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:26.212651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42023-aa1e-45c9-a8b2-4c804612db8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:26.214422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42023-aa1e-45c9-a8b2-4c804612db8c service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:26.214422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42023-aa1e-45c9-a8b2-4c804612db8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:26.214732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42023-aa1e-45c9-a8b2-4c804612db8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:26.217273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d1b42023-aa1e-45c9-a8b2-4c804612db8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:26.354406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42023-aa1e-45c9-a8b2-4c804612db8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:26.356093 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42023-aa1e-45c9-a8b2-4c804612db8c service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:26.381740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 575/1129] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:51:28.688851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f13f-36ca-4e6a-bff7-e0dcaacf3860 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:28.689483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f13f-36ca-4e6a-bff7-e0dcaacf3860 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:28.689483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822f13f-36ca-4e6a-bff7-e0dcaacf3860 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:28.690774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 555/1130] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:28.698087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74362-80d4-4968-9358-c2103d67173e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:28.698816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74362-80d4-4968-9358-c2103d67173e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:28.699022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74362-80d4-4968-9358-c2103d67173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:28.822490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:28.828141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-38b74362-80d4-4968-9358-c2103d67173e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:28.829770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-38b74362-80d4-4968-9358-c2103d67173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:28.959851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 576/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:29.251351 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822f13f-36ca-4e6a-bff7-e0dcaacf3860 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:29.253094 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3822f13f-36ca-4e6a-bff7-e0dcaacf3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:29.412939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822f13f-36ca-4e6a-bff7-e0dcaacf3860 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:29.484435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:29.516451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c7243-354c-485f-9413-a2b2a58d4dfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:29.516957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7243-354c-485f-9413-a2b2a58d4dfe service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:29.517226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7243-354c-485f-9413-a2b2a58d4dfe service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:29.517522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7243-354c-485f-9413-a2b2a58d4dfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:29.519199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6c2c7243-354c-485f-9413-a2b2a58d4dfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:29.641376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c7243-354c-485f-9413-a2b2a58d4dfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:29.642865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c7243-354c-485f-9413-a2b2a58d4dfe service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:29.672885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 556/1132] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:32.066969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e0842-25b9-4d8d-97eb-cb7260ac001b None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:32.067541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e0842-25b9-4d8d-97eb-cb7260ac001b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:32.067541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e0842-25b9-4d8d-97eb-cb7260ac001b None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:32.068861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 577/1133] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:32.075055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6550af-f3eb-4b71-b480-9cc99f8764a8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:32.075615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6550af-f3eb-4b71-b480-9cc99f8764a8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:32.075802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6550af-f3eb-4b71-b480-9cc99f8764a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:32.148179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7c6550af-f3eb-4b71-b480-9cc99f8764a8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:32.149866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7c6550af-f3eb-4b71-b480-9cc99f8764a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:32.187369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:32.279126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 557/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:32.558868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e0842-25b9-4d8d-97eb-cb7260ac001b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:32.560464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0c7e0842-25b9-4d8d-97eb-cb7260ac001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:32.671280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e0842-25b9-4d8d-97eb-cb7260ac001b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:32.702682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:32.750533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a46306-7ef7-4e28-827b-0bd2549d0c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:32.751144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46306-7ef7-4e28-827b-0bd2549d0c2a service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:32.751424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46306-7ef7-4e28-827b-0bd2549d0c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:32.751691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a46306-7ef7-4e28-827b-0bd2549d0c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:32.753331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-35a46306-7ef7-4e28-827b-0bd2549d0c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:32.882575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a46306-7ef7-4e28-827b-0bd2549d0c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:32.884059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a46306-7ef7-4e28-827b-0bd2549d0c2a service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:32.904086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 578/1135] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:35.189285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7132-90ee-4029-9fdc-bf9e18ea937d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:35.189877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7132-90ee-4029-9fdc-bf9e18ea937d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:35.189877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7132-90ee-4029-9fdc-bf9e18ea937d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:35.191246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 558/1136] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:35.197288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f95c3-16a1-4502-89a1-7449ff276ebf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:35.198120 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f95c3-16a1-4502-89a1-7449ff276ebf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:35.198278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f95c3-16a1-4502-89a1-7449ff276ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:35.274414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-382f95c3-16a1-4502-89a1-7449ff276ebf None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:35.275653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-382f95c3-16a1-4502-89a1-7449ff276ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:35.285321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:35.400072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 579/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:35.683155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7132-90ee-4029-9fdc-bf9e18ea937d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:35.684741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5c6a7132-90ee-4029-9fdc-bf9e18ea937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:35.800005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7132-90ee-4029-9fdc-bf9e18ea937d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:35.860815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:35.879950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31eca77-d221-4002-8d4b-caec69145fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:35.880557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eca77-d221-4002-8d4b-caec69145fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:35.880831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eca77-d221-4002-8d4b-caec69145fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:35.881098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31eca77-d221-4002-8d4b-caec69145fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:35.882728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e31eca77-d221-4002-8d4b-caec69145fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:35.996995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31eca77-d221-4002-8d4b-caec69145fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:35.998508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31eca77-d221-4002-8d4b-caec69145fd9 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:36.019798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 559/1138] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:38.262544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805dfd-c577-4fc0-bfb5-c8b55a6fe7fe None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:38.263107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805dfd-c577-4fc0-bfb5-c8b55a6fe7fe None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:38.263107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805dfd-c577-4fc0-bfb5-c8b55a6fe7fe None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:38.264456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 580/1139] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:38.270155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2d78-e3ae-4812-ac0a-a5ab0c61a6fd None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:38.270611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2d78-e3ae-4812-ac0a-a5ab0c61a6fd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:38.270703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b2d78-e3ae-4812-ac0a-a5ab0c61a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:38.354693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f34b2d78-e3ae-4812-ac0a-a5ab0c61a6fd None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:38.356506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f34b2d78-e3ae-4812-ac0a-a5ab0c61a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:38.400816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:38.464928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 560/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:51:38.747988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5805dfd-c577-4fc0-bfb5-c8b55a6fe7fe None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:38.749583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f5805dfd-c577-4fc0-bfb5-c8b55a6fe7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:38.866057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5805dfd-c577-4fc0-bfb5-c8b55a6fe7fe None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:38.908325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:38.951775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc53489-6d46-4b95-ad00-461903a3cbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:38.952308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc53489-6d46-4b95-ad00-461903a3cbcc service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:38.952585 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc53489-6d46-4b95-ad00-461903a3cbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:38.952849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc53489-6d46-4b95-ad00-461903a3cbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:38.954584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1dc53489-6d46-4b95-ad00-461903a3cbcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:39.076882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc53489-6d46-4b95-ad00-461903a3cbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:39.078276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc53489-6d46-4b95-ad00-461903a3cbcc service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:39.097738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 581/1141] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:41.352059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749509e-e688-4e96-9474-e2fe73222c99 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:41.352672 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749509e-e688-4e96-9474-e2fe73222c99 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:41.352672 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749509e-e688-4e96-9474-e2fe73222c99 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:41.354275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 561/1142] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:51:41.364428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0ec9-cc4b-4caf-8643-180128b2dbc9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:41.365015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0ec9-cc4b-4caf-8643-180128b2dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:41.365337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf0ec9-cc4b-4caf-8643-180128b2dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:41.464698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7bcf0ec9-cc4b-4caf-8643-180128b2dbc9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:41.465987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7bcf0ec9-cc4b-4caf-8643-180128b2dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:41.487602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:41.577527 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 582/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:41.854018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749509e-e688-4e96-9474-e2fe73222c99 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:41.855948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0749509e-e688-4e96-9474-e2fe73222c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:41.985267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749509e-e688-4e96-9474-e2fe73222c99 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:42.058067 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:42.065524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf5bf4-dacf-4b74-bf97-ff127ce69e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:42.066138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf5bf4-dacf-4b74-bf97-ff127ce69e8b service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:42.066409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf5bf4-dacf-4b74-bf97-ff127ce69e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:42.066678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf5bf4-dacf-4b74-bf97-ff127ce69e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:42.068523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9abf5bf4-dacf-4b74-bf97-ff127ce69e8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:42.215398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf5bf4-dacf-4b74-bf97-ff127ce69e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:42.216880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf5bf4-dacf-4b74-bf97-ff127ce69e8b service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:42.242663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 562/1144] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:44.514931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5c2f-47a2-43c4-863a-f1701805aad7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:44.515558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5c2f-47a2-43c4-863a-f1701805aad7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:44.515558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5c2f-47a2-43c4-863a-f1701805aad7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:44.516732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 583/1145] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:51:44.522999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4949a-f218-4ca0-997d-4488cc2ea554 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:44.523545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4949a-f218-4ca0-997d-4488cc2ea554 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:44.523545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4949a-f218-4ca0-997d-4488cc2ea554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:44.596266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-adb4949a-f218-4ca0-997d-4488cc2ea554 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:51:44.597509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-adb4949a-f218-4ca0-997d-4488cc2ea554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:44.649462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:44.711516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 563/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:51:44.999753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d5c2f-47a2-43c4-863a-f1701805aad7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:51:45.001324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-509d5c2f-47a2-43c4-863a-f1701805aad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:45.157232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d5c2f-47a2-43c4-863a-f1701805aad7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:51:45.237975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:45.276112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74e7b2-3534-483b-bb94-ee50c0ab6868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:51:45.276845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e7b2-3534-483b-bb94-ee50c0ab6868 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:51:45.277161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e7b2-3534-483b-bb94-ee50c0ab6868 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:51:45.277535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74e7b2-3534-483b-bb94-ee50c0ab6868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:51:45.279597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7a74e7b2-3534-483b-bb94-ee50c0ab6868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:51:45.413486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74e7b2-3534-483b-bb94-ee50c0ab6868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:51:45.414873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74e7b2-3534-483b-bb94-ee50c0ab6868 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:51:45.435896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 584/1147] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:51:54.709799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=22 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:51:55.433363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=66 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:05.939767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ce7b-abcf-4221-b6e5-b4abe274b3a1 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:05.940674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ce7b-abcf-4221-b6e5-b4abe274b3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:05.940674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829ce7b-abcf-4221-b6e5-b4abe274b3a1 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:05.942294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 564/1148] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:05.948961 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561c54-bb8a-4d17-b783-4de36775d6d4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:05.949765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561c54-bb8a-4d17-b783-4de36775d6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:05.949765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99561c54-bb8a-4d17-b783-4de36775d6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:06.056152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-99561c54-bb8a-4d17-b783-4de36775d6d4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:06.058593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-99561c54-bb8a-4d17-b783-4de36775d6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:06.209371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 585/1149] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:06.603575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b6fb5-c8c1-4652-92b1-17e824259c0c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:06.603859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b6fb5-c8c1-4652-92b1-17e824259c0c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:06.604118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b6fb5-c8c1-4652-92b1-17e824259c0c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:06.605693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 565/1150] 10.222.0.52 () {54 vars in 962 bytes} [Fri Oct 28 19:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:06.611740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aab52-aa33-4035-8d59-4955e0176f31 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:06.612034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aab52-aa33-4035-8d59-4955e0176f31 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:06.612275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aab52-aa33-4035-8d59-4955e0176f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:06.704156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-709aab52-aa33-4035-8d59-4955e0176f31 None None] MFA Rules not processed for user `237bbe3771c249449b4c2cad20fa5ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:06.705461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-709aab52-aa33-4035-8d59-4955e0176f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:06.732409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:06.813509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 586/1151] 10.222.0.52 () {58 vars in 1059 bytes} [Fri Oct 28 19:52:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:06.822208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b6fb5-c8c1-4652-92b1-17e824259c0c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:06.824056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c43b6fb5-c8c1-4652-92b1-17e824259c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:06.957000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b6fb5-c8c1-4652-92b1-17e824259c0c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:07.048171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca761b7c-6551-422a-858b-7390fe662310 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:07.048787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761b7c-6551-422a-858b-7390fe662310 service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:07.049058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761b7c-6551-422a-858b-7390fe662310 service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:07.049321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca761b7c-6551-422a-858b-7390fe662310 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:07.051051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ca761b7c-6551-422a-858b-7390fe662310 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:07.117254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:07.189269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca761b7c-6551-422a-858b-7390fe662310 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:07.190796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca761b7c-6551-422a-858b-7390fe662310 service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:07.213974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 566/1152] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:09.643197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cf6c-6312-4bb4-b9f5-97927fc22bf6 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:09.643854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cf6c-6312-4bb4-b9f5-97927fc22bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:09.643854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cf6c-6312-4bb4-b9f5-97927fc22bf6 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:09.645480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 587/1153] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:52:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:09.652030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a9d7-ec6f-466d-98cf-a9c8a25ad113 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:09.652654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a9d7-ec6f-466d-98cf-a9c8a25ad113 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:09.652654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558a9d7-ec6f-466d-98cf-a9c8a25ad113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:09.731996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a558a9d7-ec6f-466d-98cf-a9c8a25ad113 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:09.733440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a558a9d7-ec6f-466d-98cf-a9c8a25ad113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:09.849931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 567/1154] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:10.267202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cf6c-6312-4bb4-b9f5-97927fc22bf6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:10.268945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8678cf6c-6312-4bb4-b9f5-97927fc22bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:10.447208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cf6c-6312-4bb4-b9f5-97927fc22bf6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:10.507201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:10.567985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dd675-773a-4a18-adda-d254e8d2592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:10.568733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd675-773a-4a18-adda-d254e8d2592b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:10.569071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd675-773a-4a18-adda-d254e8d2592b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:10.569414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dd675-773a-4a18-adda-d254e8d2592b admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:10.570190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dd675-773a-4a18-adda-d254e8d2592b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:10.571287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-c14dd675-773a-4a18-adda-d254e8d2592b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:52:10.571287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:52:10.571287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:52:10.572633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14dd675-773a-4a18-adda-d254e8d2592b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:10.595734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 588/1155] 10.222.0.52 () {56 vars in 1108 bytes} [Fri Oct 28 19:52:10 2022] GET /identity/v3/projects => generated 2553 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:52:13.168747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40237a30-9346-4cd9-9870-9351cdfd000f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:13.169408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40237a30-9346-4cd9-9870-9351cdfd000f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:13.169408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40237a30-9346-4cd9-9870-9351cdfd000f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:13.171170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 568/1156] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:13.177416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e20b1-5b28-408d-8c0e-91a31f44f178 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:13.178013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e20b1-5b28-408d-8c0e-91a31f44f178 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:13.178013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e20b1-5b28-408d-8c0e-91a31f44f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:13.260002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e31e20b1-5b28-408d-8c0e-91a31f44f178 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:13.261707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e31e20b1-5b28-408d-8c0e-91a31f44f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:13.381985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 589/1157] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:13.685792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40237a30-9346-4cd9-9870-9351cdfd000f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:13.688292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-40237a30-9346-4cd9-9870-9351cdfd000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:13.699894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:13.867369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40237a30-9346-4cd9-9870-9351cdfd000f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:13.968426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:14.008014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f223ff-a009-4e2f-bbe6-321efd9d0144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:14.008639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f223ff-a009-4e2f-bbe6-321efd9d0144 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:14.008913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f223ff-a009-4e2f-bbe6-321efd9d0144 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:14.009162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f223ff-a009-4e2f-bbe6-321efd9d0144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:14.010874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a9f223ff-a009-4e2f-bbe6-321efd9d0144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:14.117630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f223ff-a009-4e2f-bbe6-321efd9d0144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:14.119459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f223ff-a009-4e2f-bbe6-321efd9d0144 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:14.142411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 569/1158] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:16.628231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95513d8-824e-4f66-b889-4777f262843c None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:16.628861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95513d8-824e-4f66-b889-4777f262843c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:16.628861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95513d8-824e-4f66-b889-4777f262843c None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:16.630162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 590/1159] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:16.637135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbb09-5e83-4a40-a3b3-dbcec9d20a47 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:16.637866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbb09-5e83-4a40-a3b3-dbcec9d20a47 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:16.637866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbb09-5e83-4a40-a3b3-dbcec9d20a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:16.712999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cc6bbb09-5e83-4a40-a3b3-dbcec9d20a47 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:16.714259 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cc6bbb09-5e83-4a40-a3b3-dbcec9d20a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:16.784880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:16.841928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 570/1160] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:17.127348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95513d8-824e-4f66-b889-4777f262843c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:17.130182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d95513d8-824e-4f66-b889-4777f262843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:17.175721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:17.299323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95513d8-824e-4f66-b889-4777f262843c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:17.391314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedf4b0-fdfe-431d-8b1e-9ed256cfb515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:17.391828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf4b0-fdfe-431d-8b1e-9ed256cfb515 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:17.392109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf4b0-fdfe-431d-8b1e-9ed256cfb515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:17.392379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedf4b0-fdfe-431d-8b1e-9ed256cfb515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:17.394180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6dedf4b0-fdfe-431d-8b1e-9ed256cfb515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:17.487129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:17.529517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedf4b0-fdfe-431d-8b1e-9ed256cfb515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:17.531158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedf4b0-fdfe-431d-8b1e-9ed256cfb515 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:17.555230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 591/1161] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:19.942577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2cae-7a3b-47b7-bf33-ffa8b1d3465e None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:19.943273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2cae-7a3b-47b7-bf33-ffa8b1d3465e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:19.943273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e2cae-7a3b-47b7-bf33-ffa8b1d3465e None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:19.944473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 571/1162] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:19.950443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3f41-ef90-44cb-96ba-b76fde981212 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:19.951249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3f41-ef90-44cb-96ba-b76fde981212 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:19.951460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa3f41-ef90-44cb-96ba-b76fde981212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:20.023647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4efa3f41-ef90-44cb-96ba-b76fde981212 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:20.024860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4efa3f41-ef90-44cb-96ba-b76fde981212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:20.130321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 592/1163] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:20.413038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e2cae-7a3b-47b7-bf33-ffa8b1d3465e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:20.414636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-637e2cae-7a3b-47b7-bf33-ffa8b1d3465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:20.531247 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e2cae-7a3b-47b7-bf33-ffa8b1d3465e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:20.616441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:20.618216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9cb4f-aa11-4d8d-95eb-d795c3335c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:20.619123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9cb4f-aa11-4d8d-95eb-d795c3335c4c service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:20.619622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9cb4f-aa11-4d8d-95eb-d795c3335c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:20.620322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9cb4f-aa11-4d8d-95eb-d795c3335c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:20.622879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-13d9cb4f-aa11-4d8d-95eb-d795c3335c4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:20.750651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9cb4f-aa11-4d8d-95eb-d795c3335c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:20.752105 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9cb4f-aa11-4d8d-95eb-d795c3335c4c service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:20.773318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 572/1164] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:23.085313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9de1-0769-440e-8203-0d0882d6181a None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.085936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9de1-0769-440e-8203-0d0882d6181a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.085936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da9de1-0769-440e-8203-0d0882d6181a None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.087261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 593/1165] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:23.094014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807487f-9ffe-40e5-9530-1d8c77428753 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.094689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807487f-9ffe-40e5-9530-1d8c77428753 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.094832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807487f-9ffe-40e5-9530-1d8c77428753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.177273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3807487f-9ffe-40e5-9530-1d8c77428753 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:23.178574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3807487f-9ffe-40e5-9530-1d8c77428753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.239984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:23.287817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 573/1166] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:23.576845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da9de1-0769-440e-8203-0d0882d6181a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:23.578434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f8da9de1-0769-440e-8203-0d0882d6181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.620734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:23.698262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da9de1-0769-440e-8203-0d0882d6181a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:23.777166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4e58b-65e7-4c22-a2d7-4d5a6b4b47b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:23.777816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e58b-65e7-4c22-a2d7-4d5a6b4b47b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:23.778090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e58b-65e7-4c22-a2d7-4d5a6b4b47b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:23.778357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4e58b-65e7-4c22-a2d7-4d5a6b4b47b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:23.779979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8ff4e58b-65e7-4c22-a2d7-4d5a6b4b47b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:23.879957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:23.912031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4e58b-65e7-4c22-a2d7-4d5a6b4b47b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:23.913639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4e58b-65e7-4c22-a2d7-4d5a6b4b47b6 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:23.934925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 594/1167] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:26.351742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853052-eda1-4c5d-8038-8d071707f4b4 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.352358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853052-eda1-4c5d-8038-8d071707f4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.352358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97853052-eda1-4c5d-8038-8d071707f4b4 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.353777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 574/1168] 10.222.0.52 () {54 vars in 927 bytes} [Fri Oct 28 19:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:52:26.360096 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b11a-503b-4447-bed7-9c89f36808b5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:26.360719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b11a-503b-4447-bed7-9c89f36808b5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:26.360719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89b11a-503b-4447-bed7-9c89f36808b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:26.443709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ea89b11a-503b-4447-bed7-9c89f36808b5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:52:26.444975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ea89b11a-503b-4447-bed7-9c89f36808b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:26.570618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 595/1169] 10.222.0.52 () {58 vars in 1024 bytes} [Fri Oct 28 19:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:52:26.859847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853052-eda1-4c5d-8038-8d071707f4b4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:52:26.861421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-97853052-eda1-4c5d-8038-8d071707f4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:26.986191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97853052-eda1-4c5d-8038-8d071707f4b4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:52:27.070718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302574b-fd60-4901-9746-e0294b733ecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:52:27.071472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302574b-fd60-4901-9746-e0294b733ecc service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:52:27.071847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302574b-fd60-4901-9746-e0294b733ecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:52:27.072221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302574b-fd60-4901-9746-e0294b733ecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:52:27.074117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9302574b-fd60-4901-9746-e0294b733ecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:52:27.084100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:27.203048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302574b-fd60-4901-9746-e0294b733ecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:52:27.204494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302574b-fd60-4901-9746-e0294b733ecc service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:52:27.224528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 575/1170] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:52:36.568848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=82 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:52:37.221699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=50 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:43.206647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.207284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.207284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.310314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:43.311580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:43.424603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 596/1171] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:43.433221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4191-e8f0-4af5-94a1-a7c9bf47c506 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.433823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4191-e8f0-4af5-94a1-a7c9bf47c506 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.433823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a4191-e8f0-4af5-94a1-a7c9bf47c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.527421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-338a4191-e8f0-4af5-94a1-a7c9bf47c506 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:43.528693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-338a4191-e8f0-4af5-94a1-a7c9bf47c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:43.662044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 576/1172] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:43.668407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.669670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:43.683146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff8c7d-999d-45b1-b4f9-43ad913751a0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.765842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:43.806166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.806682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.806966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.807224 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.807880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:53:43.808599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.809676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:53:43.809676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:53:43.809676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:53:43.810598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:43.824121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 597/1173] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:53:43.834660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a4191-e8f0-4af5-94a1-a7c9bf47c506 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:43.844911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a4191-e8f0-4af5-94a1-a7c9bf47c506 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:43.914014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:43.954771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:43.955396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:43.955690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:43.956070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:43.956737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:43.957978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:53:43.957978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:53:43.957978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:53:43.959226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.026183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 577/1174] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:53:43 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:44.037169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.038931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:44.074696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55d9fc-bece-46ba-afa9-bf691ff413dc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.197631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.198280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.198559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.198837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.199529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.200622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:53:44.200622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:53:44.200622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:53:44.201946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.251986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 598/1175] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:53:44 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:53:44.258841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.261847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:44.346940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e7b33-02b1-40e2-a950-c521f917413c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.441772 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:44.455164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.455807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.456077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.456339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.457028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.458762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.475441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 578/1176] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:44.479706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.481309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:44.493314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780a15a-595f-4d1e-b775-5e5b6b86ee28 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.522454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:44.608810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9957ad-22b5-47ac-bb50-358627b4379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.609305 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9957ad-22b5-47ac-bb50-358627b4379d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.609612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9957ad-22b5-47ac-bb50-358627b4379d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.609882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9957ad-22b5-47ac-bb50-358627b4379d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.610591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9957ad-22b5-47ac-bb50-358627b4379d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.612241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9957ad-22b5-47ac-bb50-358627b4379d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.629706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 599/1177] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:53:44.631205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:44.633125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:44.677750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa422e-141c-4f39-a671-1844495fa975 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:44.855546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344430d-438c-4cff-84dd-09f487d1ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:44.856720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344430d-438c-4cff-84dd-09f487d1ed40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.857227 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344430d-438c-4cff-84dd-09f487d1ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.857636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344430d-438c-4cff-84dd-09f487d1ed40 admin admin] PATH_INFO: `/v3/projects/799d0884ef284a8b8328558df817b9b3/users/27985bd412d244fd8c9b1cd979642173/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:44.893792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344430d-438c-4cff-84dd-09f487d1ed40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=799d0884ef284a8b8328558df817b9b3, user_id=27985bd412d244fd8c9b1cd979642173, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:44.896472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344430d-438c-4cff-84dd-09f487d1ed40 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:44.930116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 579/1178] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:53:44 2022] PUT /identity/v3/projects/799d0884ef284a8b8328558df817b9b3/users/27985bd412d244fd8c9b1cd979642173/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:44.942214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b9d0-7442-449e-b99d-e8de359b52af None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:44.942553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b9d0-7442-449e-b99d-e8de359b52af None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:44.942766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427b9d0-7442-449e-b99d-e8de359b52af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.020948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2427b9d0-7442-449e-b99d-e8de359b52af None None] MFA Rules not processed for user `27985bd412d244fd8c9b1cd979642173`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:45.023082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2427b9d0-7442-449e-b99d-e8de359b52af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:45.144999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 600/1179] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:45.163966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a597d-9c67-4e29-9946-ce38f6d7f5c3 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:45.164422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a597d-9c67-4e29-9946-ce38f6d7f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:45.164750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a597d-9c67-4e29-9946-ce38f6d7f5c3 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.166765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 580/1180] 10.222.0.52 () {54 vars in 963 bytes} [Fri Oct 28 19:53:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:53:45.172361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eee48-aefe-4a2f-b1ee-e7958e2713ca None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:45.172640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eee48-aefe-4a2f-b1ee-e7958e2713ca None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:45.172868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829eee48-aefe-4a2f-b1ee-e7958e2713ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.210344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:45.266696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-829eee48-aefe-4a2f-b1ee-e7958e2713ca None None] MFA Rules not processed for user `e609d787cb964803b2630895f155a2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:45.267978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-829eee48-aefe-4a2f-b1ee-e7958e2713ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:45.359041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 601/1181] 10.222.0.52 () {58 vars in 1060 bytes} [Fri Oct 28 19:53:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:53:45.367674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a597d-9c67-4e29-9946-ce38f6d7f5c3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:45.369414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f64a597d-9c67-4e29-9946-ce38f6d7f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:45.430904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:45.494059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a597d-9c67-4e29-9946-ce38f6d7f5c3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:45.588182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:45.588885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:45.589158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:45.589451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.591097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:45.717463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:45.720531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:45.728216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:45.758653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 581/1182] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:45.815287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d846261-3606-4195-b92b-c68b0a1a49c4 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:45.815568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d846261-3606-4195-b92b-c68b0a1a49c4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:45.815858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d846261-3606-4195-b92b-c68b0a1a49c4 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:45.817162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 602/1183] 10.222.0.52 () {52 vars in 830 bytes} [Fri Oct 28 19:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:53:45.821485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:45.822913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:45.963464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a866838-2dfd-4c3c-9ea1-d0e41b6b5cba service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:46.070140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:46.070678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:46.070953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:46.071224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] PATH_INFO: `/v3/users/27985bd412d244fd8c9b1cd979642173` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:46.085883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] RBAC: Authorizing `identity:delete_user(user_id=27985bd412d244fd8c9b1cd979642173)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:46.086930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:53:46.086930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:53:46.086930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:53:46.088208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:46.099443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:46.162555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27985bd412d244fd8c9b1cd979642173'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.191095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27985bd412d244fd8c9b1cd979642173'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.191593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27985bd412d244fd8c9b1cd979642173'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.208398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27985bd412d244fd8c9b1cd979642173'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.208996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27985bd412d244fd8c9b1cd979642173'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:46.226942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 582/1184] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:53:45 2022] DELETE /identity/v3/users/27985bd412d244fd8c9b1cd979642173 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:46.231877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:46.232161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:46.232435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:46.300733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:53:46.302359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:46.385042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:46.400606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 603/1185] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:53:46.411318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:46.412592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:46.519168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797188f-d659-498c-b7d1-f696c4cb916b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:46.582586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:46.608146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23636da8-71c0-45d1-9a44-14f342aa052b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:46.608790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23636da8-71c0-45d1-9a44-14f342aa052b service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:46.615940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23636da8-71c0-45d1-9a44-14f342aa052b service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:46.615940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23636da8-71c0-45d1-9a44-14f342aa052b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:46.615940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-23636da8-71c0-45d1-9a44-14f342aa052b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:46.745847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23636da8-71c0-45d1-9a44-14f342aa052b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:46.747292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23636da8-71c0-45d1-9a44-14f342aa052b service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:46.769501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 583/1186] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:53:47.145208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:53:47.146849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:53:47.160760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e692deb-7d22-43d2-88a6-d237a68d31a7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:53:47.302023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:53:47.302799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:53:47.303100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:53:47.303408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] PATH_INFO: `/v3/projects/799d0884ef284a8b8328558df817b9b3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:53:47.315705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=799d0884ef284a8b8328558df817b9b3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:53:47.316814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:53:47.316814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:53:47.316814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:53:47.318302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:53:47.390338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '799d0884ef284a8b8328558df817b9b3', 'request_id': 'req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.410490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '799d0884ef284a8b8328558df817b9b3', 'request_id': 'req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.417194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '799d0884ef284a8b8328558df817b9b3', 'request_id': 'req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.445608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] The token cache is being invalidate because project 799d0884ef284a8b8328558df817b9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:53:47.445885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.446358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ba8c3a41-30e6-4160-af85-c9c12e8c3e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:53:47.447865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 604/1187] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:53:47 2022] DELETE /identity/v3/projects/799d0884ef284a8b8328558df817b9b3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:53:56.766920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=62 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:53:57.443416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:23.625797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a976-609e-478c-bb89-0fd389ecc40d None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:23.626444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a976-609e-478c-bb89-0fd389ecc40d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:23.626444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca4a976-609e-478c-bb89-0fd389ecc40d None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:23.627778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 584/1188] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:23.634183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6f047-f1be-4c06-b504-111d6d781475 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:23.634789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6f047-f1be-4c06-b504-111d6d781475 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:23.634883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6f047-f1be-4c06-b504-111d6d781475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:23.740625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0cb6f047-f1be-4c06-b504-111d6d781475 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:23.741947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0cb6f047-f1be-4c06-b504-111d6d781475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:23.873698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 605/1189] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:24.036089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a976-609e-478c-bb89-0fd389ecc40d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:24.039236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5ca4a976-609e-478c-bb89-0fd389ecc40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:24.175038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca4a976-609e-478c-bb89-0fd389ecc40d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:24.180817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1eff3-f9af-4c70-8d07-47a591136608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:24.181503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1eff3-f9af-4c70-8d07-47a591136608 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:24.181768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1eff3-f9af-4c70-8d07-47a591136608 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:24.182040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1eff3-f9af-4c70-8d07-47a591136608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:24.191388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1eff3-f9af-4c70-8d07-47a591136608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:24.193005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1eff3-f9af-4c70-8d07-47a591136608 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:24.203736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 585/1190] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:25.328854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7233f2d-f4d4-4cf2-ada5-1560653c50d7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.329676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7233f2d-f4d4-4cf2-ada5-1560653c50d7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.329676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7233f2d-f4d4-4cf2-ada5-1560653c50d7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.331310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 606/1191] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:25.336778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048556f0-4add-49c3-83ae-2e56e98deb3e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.337267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048556f0-4add-49c3-83ae-2e56e98deb3e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.337267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048556f0-4add-49c3-83ae-2e56e98deb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.359817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-048556f0-4add-49c3-83ae-2e56e98deb3e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:25.361061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-048556f0-4add-49c3-83ae-2e56e98deb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:25.370315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 586/1192] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:25.528579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7233f2d-f4d4-4cf2-ada5-1560653c50d7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:25.544099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7233f2d-f4d4-4cf2-ada5-1560653c50d7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:25.550427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60157b8-9b88-43d8-be5a-80c6b23b77b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:25.551047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60157b8-9b88-43d8-be5a-80c6b23b77b4 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.551330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60157b8-9b88-43d8-be5a-80c6b23b77b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.551627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60157b8-9b88-43d8-be5a-80c6b23b77b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.563513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60157b8-9b88-43d8-be5a-80c6b23b77b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:25.565946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60157b8-9b88-43d8-be5a-80c6b23b77b4 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:25.578152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 607/1193] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:25.753540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d788e7-e067-499e-8b81-0b18ec8dc0d2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.753842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d788e7-e067-499e-8b81-0b18ec8dc0d2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.754147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d788e7-e067-499e-8b81-0b18ec8dc0d2 None None] PATH_INFO: `/v3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.755480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 587/1194] 10.222.0.65 () {54 vars in 925 bytes} [Fri Oct 28 19:55:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:55:25.762967 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac39d5-d9f9-4a1d-9a55-3190f32ee6f9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:25.763255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac39d5-d9f9-4a1d-9a55-3190f32ee6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:25.763530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac39d5-d9f9-4a1d-9a55-3190f32ee6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:25.830856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a1ac39d5-d9f9-4a1d-9a55-3190f32ee6f9 None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:25.831988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a1ac39d5-d9f9-4a1d-9a55-3190f32ee6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:25.850196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:25.910421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 608/1195] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Oct 28 19:55:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:29.537027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764d9c-7fbf-4df9-bb11-f122ae4649a1 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:29.537577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764d9c-7fbf-4df9-bb11-f122ae4649a1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:29.537577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d764d9c-7fbf-4df9-bb11-f122ae4649a1 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:29.538929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 588/1196] 10.222.0.52 () {54 vars in 961 bytes} [Fri Oct 28 19:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:29.546901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e15a-eef1-400e-bdf5-ccbd49c3326a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:29.547669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e15a-eef1-400e-bdf5-ccbd49c3326a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:29.547810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1e15a-eef1-400e-bdf5-ccbd49c3326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:29.573048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-aad1e15a-eef1-400e-bdf5-ccbd49c3326a None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:29.574478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-aad1e15a-eef1-400e-bdf5-ccbd49c3326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:29.585791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 609/1197] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Oct 28 19:55:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:29.594341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764d9c-7fbf-4df9-bb11-f122ae4649a1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:29.616685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d764d9c-7fbf-4df9-bb11-f122ae4649a1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:29.623124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6954369-4731-4ba6-853f-598382721312 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:29.623829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954369-4731-4ba6-853f-598382721312 service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:29.624139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954369-4731-4ba6-853f-598382721312 service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:29.624479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6954369-4731-4ba6-853f-598382721312 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:29.634829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6954369-4731-4ba6-853f-598382721312 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:29.637575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6954369-4731-4ba6-853f-598382721312 service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:29.650522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 589/1198] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:37.108766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ecdd-9ee6-4f15-a9e6-df2e32f1b8e9 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.110092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ecdd-9ee6-4f15-a9e6-df2e32f1b8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.110092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ecdd-9ee6-4f15-a9e6-df2e32f1b8e9 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.111056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 610/1199] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:55:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:37.117330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42568-0de3-4527-9de9-458884093f68 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.117931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42568-0de3-4527-9de9-458884093f68 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.117931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af42568-0de3-4527-9de9-458884093f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.139842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9af42568-0de3-4527-9de9-458884093f68 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:37.141063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9af42568-0de3-4527-9de9-458884093f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:37.149817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 590/1200] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:37.302170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ecdd-9ee6-4f15-a9e6-df2e32f1b8e9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:37.318615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ecdd-9ee6-4f15-a9e6-df2e32f1b8e9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:37.324699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ef5f0-f044-47b7-9dc4-16a7a0f483a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:37.325331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ef5f0-f044-47b7-9dc4-16a7a0f483a4 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:37.325642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ef5f0-f044-47b7-9dc4-16a7a0f483a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:37.325916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ef5f0-f044-47b7-9dc4-16a7a0f483a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:37.334834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ef5f0-f044-47b7-9dc4-16a7a0f483a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:37.336441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ef5f0-f044-47b7-9dc4-16a7a0f483a4 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:37.346053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 611/1201] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:55:38.426709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7400fb-db2b-453a-8002-d395913711b3 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.427306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7400fb-db2b-453a-8002-d395913711b3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.427306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7400fb-db2b-453a-8002-d395913711b3 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.428610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 591/1202] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 28 19:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:38.434084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a0b5-2bbe-4a78-bfdf-87bd77dc91da None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.434593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a0b5-2bbe-4a78-bfdf-87bd77dc91da None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.434593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3a0b5-2bbe-4a78-bfdf-87bd77dc91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.456268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-27d3a0b5-2bbe-4a78-bfdf-87bd77dc91da None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:38.457509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-27d3a0b5-2bbe-4a78-bfdf-87bd77dc91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:38.466301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 612/1203] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 28 19:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:38.617689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7400fb-db2b-453a-8002-d395913711b3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:38.634021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7400fb-db2b-453a-8002-d395913711b3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:38.640484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c38914-7823-4ab7-8517-bbc42a72b357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:38.641092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38914-7823-4ab7-8517-bbc42a72b357 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:38.641371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38914-7823-4ab7-8517-bbc42a72b357 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:38.641695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38914-7823-4ab7-8517-bbc42a72b357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:38.651543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38914-7823-4ab7-8517-bbc42a72b357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:38.653768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38914-7823-4ab7-8517-bbc42a72b357 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:38.669740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 592/1204] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:42.819660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2858d-d5db-4f21-93b2-cd927e1e09ca None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:42.820268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2858d-d5db-4f21-93b2-cd927e1e09ca None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:42.820268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2858d-d5db-4f21-93b2-cd927e1e09ca None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:42.821634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 613/1205] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:42.827596 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd303-149d-456d-a184-582f4987f82a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:42.828128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd303-149d-456d-a184-582f4987f82a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:42.828128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fddd303-149d-456d-a184-582f4987f82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:42.850005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9fddd303-149d-456d-a184-582f4987f82a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:42.851224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9fddd303-149d-456d-a184-582f4987f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:42.860710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 593/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:43.149453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2858d-d5db-4f21-93b2-cd927e1e09ca None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:43.151529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c0d2858d-d5db-4f21-93b2-cd927e1e09ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:43.245814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2858d-d5db-4f21-93b2-cd927e1e09ca None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:43.250119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26c09c-1c76-45d4-9aad-8ec59f1f238f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:43.250880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26c09c-1c76-45d4-9aad-8ec59f1f238f service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:43.251156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26c09c-1c76-45d4-9aad-8ec59f1f238f service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:43.251430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26c09c-1c76-45d4-9aad-8ec59f1f238f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:43.263413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26c09c-1c76-45d4-9aad-8ec59f1f238f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:43.265186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26c09c-1c76-45d4-9aad-8ec59f1f238f service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:43.277292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 614/1207] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:45.652823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb837-fe07-4e80-bdab-2c6679ed60e2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:45.653442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb837-fe07-4e80-bdab-2c6679ed60e2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:45.653442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596eb837-fe07-4e80-bdab-2c6679ed60e2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:45.654710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 594/1208] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:45.660779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ac3c-8cf0-4761-9a8e-431dc6a8bdec None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:45.661590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ac3c-8cf0-4761-9a8e-431dc6a8bdec None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:45.661590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567ac3c-8cf0-4761-9a8e-431dc6a8bdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:45.681837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e567ac3c-8cf0-4761-9a8e-431dc6a8bdec None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:45.683040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e567ac3c-8cf0-4761-9a8e-431dc6a8bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:45.691607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 615/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:45.972429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb837-fe07-4e80-bdab-2c6679ed60e2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:45.986250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596eb837-fe07-4e80-bdab-2c6679ed60e2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:45.990153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c69ca-d394-4ee9-bd7d-bdec6cd4e69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:45.990756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c69ca-d394-4ee9-bd7d-bdec6cd4e69e service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:45.991028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c69ca-d394-4ee9-bd7d-bdec6cd4e69e service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:45.991302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c69ca-d394-4ee9-bd7d-bdec6cd4e69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:46.004217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c69ca-d394-4ee9-bd7d-bdec6cd4e69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:46.006574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c69ca-d394-4ee9-bd7d-bdec6cd4e69e service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:46.018728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 595/1210] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:49.831909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a6aa7-415e-4dc9-b032-6fed14ea5de7 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:49.832497 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a6aa7-415e-4dc9-b032-6fed14ea5de7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:49.832497 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a6aa7-415e-4dc9-b032-6fed14ea5de7 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:49.833924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 616/1211] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:49.839732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e660-eb86-45e1-8d85-c856fdf13712 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:49.840267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e660-eb86-45e1-8d85-c856fdf13712 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:49.840267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93e660-eb86-45e1-8d85-c856fdf13712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:49.848416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=81 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:49.862174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-dd93e660-eb86-45e1-8d85-c856fdf13712 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:49.863379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dd93e660-eb86-45e1-8d85-c856fdf13712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:49.871820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 596/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:50.171010 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a6aa7-415e-4dc9-b032-6fed14ea5de7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:50.173022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9d7a6aa7-415e-4dc9-b032-6fed14ea5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:50.248400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:55:50.264235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a6aa7-415e-4dc9-b032-6fed14ea5de7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:50.268579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d816ff1-26b2-4920-a550-075581a254f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:50.269223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816ff1-26b2-4920-a550-075581a254f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:50.269545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816ff1-26b2-4920-a550-075581a254f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:50.269824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816ff1-26b2-4920-a550-075581a254f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:50.279445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816ff1-26b2-4920-a550-075581a254f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:50.280958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d816ff1-26b2-4920-a550-075581a254f1 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:50.290937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 617/1213] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:55:52.476695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456639c8-05cf-49ff-9e74-7c545b22010c None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:52.477614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456639c8-05cf-49ff-9e74-7c545b22010c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:52.477813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456639c8-05cf-49ff-9e74-7c545b22010c None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:52.479963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 597/1214] 127.0.0.1 () {54 vars in 917 bytes} [Fri Oct 28 19:55:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:55:52.488699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b75e41-ddd2-4aeb-a3d3-a6389df47de5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:52.489194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b75e41-ddd2-4aeb-a3d3-a6389df47de5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:52.489296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b75e41-ddd2-4aeb-a3d3-a6389df47de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:52.514854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-52b75e41-ddd2-4aeb-a3d3-a6389df47de5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:55:52.516065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-52b75e41-ddd2-4aeb-a3d3-a6389df47de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:52.524570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 618/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Oct 28 19:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:55:52.819652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456639c8-05cf-49ff-9e74-7c545b22010c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:55:52.821508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-456639c8-05cf-49ff-9e74-7c545b22010c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:55:52.835454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456639c8-05cf-49ff-9e74-7c545b22010c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:55:52.839304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33faec00-1149-42c0-ae12-ff4e033da1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:55:52.839907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faec00-1149-42c0-ae12-ff4e033da1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:55:52.840182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faec00-1149-42c0-ae12-ff4e033da1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:55:52.840474 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33faec00-1149-42c0-ae12-ff4e033da1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:55:52.850904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faec00-1149-42c0-ae12-ff4e033da1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:55:52.852357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33faec00-1149-42c0-ae12-ff4e033da1c5 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:55:52.862649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 598/1216] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:56:02.509539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=11 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:56:02.858029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=8 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:19.689960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d9e1-47ae-4563-856b-8f6f81ea95e0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:19.690641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d9e1-47ae-4563-856b-8f6f81ea95e0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:19.690641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94d9e1-47ae-4563-856b-8f6f81ea95e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:19.715675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ef94d9e1-47ae-4563-856b-8f6f81ea95e0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:19.716925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ef94d9e1-47ae-4563-856b-8f6f81ea95e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:19.729072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 619/1217] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:19.742381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba485f-5679-4555-b3d6-4d93a92ec566 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:19.742997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba485f-5679-4555-b3d6-4d93a92ec566 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:19.742997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba485f-5679-4555-b3d6-4d93a92ec566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:19.774616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-37ba485f-5679-4555-b3d6-4d93a92ec566 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:19.775870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-37ba485f-5679-4555-b3d6-4d93a92ec566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:19.788141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 599/1218] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:19.792857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d9e1-47ae-4563-856b-8f6f81ea95e0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:19.808531 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94d9e1-47ae-4563-856b-8f6f81ea95e0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:19.815855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c34c7-664c-4534-8c64-247c464b05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:19.816697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c34c7-664c-4534-8c64-247c464b05e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:19.817118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c34c7-664c-4534-8c64-247c464b05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:19.817417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c34c7-664c-4534-8c64-247c464b05e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:19.818095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c34c7-664c-4534-8c64-247c464b05e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:19.818397 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c34c7-664c-4534-8c64-247c464b05e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:19.820137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c34c7-664c-4534-8c64-247c464b05e1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:19.837861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 620/1219] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:19.846561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba485f-5679-4555-b3d6-4d93a92ec566 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:19.859237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba485f-5679-4555-b3d6-4d93a92ec566 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:19.864628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78854a-c1e5-4de9-8bbc-403269da0f7e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:19.865002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78854a-c1e5-4de9-8bbc-403269da0f7e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:19.865288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78854a-c1e5-4de9-8bbc-403269da0f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:19.869185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:19.869872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:19.870150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:19.870421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:19.871068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:19.873054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:19.897882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ee78854a-c1e5-4de9-8bbc-403269da0f7e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:19.899518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ee78854a-c1e5-4de9-8bbc-403269da0f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:19.912814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 621/1220] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:19.938491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49fd4e-d04f-4821-bde7-72e590305b17 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:19.939369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49fd4e-d04f-4821-bde7-72e590305b17 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:19.939856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49fd4e-d04f-4821-bde7-72e590305b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:19.955600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 600/1221] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:19 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:19.968976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:19.979968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ba49fd4e-d04f-4821-bde7-72e590305b17 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:19.981563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ba49fd4e-d04f-4821-bde7-72e590305b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.079466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fddfa-8b68-4e3e-86d6-bcd2ef641594 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.095863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.096827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.097264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.097721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.098539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.099747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:57:20.099747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:57:20.099747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:57:20.101422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.125415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 622/1222] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.127425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cba6e-2a27-4b77-8bad-3795802aa65f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.127821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cba6e-2a27-4b77-8bad-3795802aa65f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.128199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cba6e-2a27-4b77-8bad-3795802aa65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.140453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 601/1223] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:19 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:57:20.141756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.163883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26cef7a-7f9f-4103-a8c0-c9d0641caaab admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.165772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5d9cba6e-2a27-4b77-8bad-3795802aa65f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.167000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5d9cba6e-2a27-4b77-8bad-3795802aa65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.175680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.176331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.176620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.177030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.177731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:20.178038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.179133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:57:20.179133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:57:20.179133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:57:20.180348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.180698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 623/1224] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.182036 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9d37-377d-45fe-9d1e-7b80dc4111e6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.182319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9d37-377d-45fe-9d1e-7b80dc4111e6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.182593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e9d37-377d-45fe-9d1e-7b80dc4111e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.209690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 602/1225] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:20.210886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.223685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c77e9d37-377d-45fe-9d1e-7b80dc4111e6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.224908 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c77e9d37-377d-45fe-9d1e-7b80dc4111e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.232327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82160ae2-3ee2-4a7d-bf66-e064f845e569 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.238480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 624/1226] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.239927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c95dce-853f-4545-abd3-fd49112dc7ef None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.240217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c95dce-853f-4545-abd3-fd49112dc7ef None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.240491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c95dce-853f-4545-abd3-fd49112dc7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.247674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.248362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.248641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.248912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.249735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.251617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.277731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-82c95dce-853f-4545-abd3-fd49112dc7ef None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.279493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-82c95dce-853f-4545-abd3-fd49112dc7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.279611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 603/1227] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:20.280522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.305308 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af01aa-d86c-4348-afe6-8fc20e094543 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.307999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 625/1228] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.309526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f22a46-c087-49c0-a4e0-b5d2b2d95ea7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.310741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f22a46-c087-49c0-a4e0-b5d2b2d95ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.311020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f22a46-c087-49c0-a4e0-b5d2b2d95ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.317705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b9fe-ad2b-4a77-93de-48115c2e0a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.318337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b9fe-ad2b-4a77-93de-48115c2e0a82 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.318615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b9fe-ad2b-4a77-93de-48115c2e0a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.318884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b9fe-ad2b-4a77-93de-48115c2e0a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.319517 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b9fe-ad2b-4a77-93de-48115c2e0a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.321504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b9fe-ad2b-4a77-93de-48115c2e0a82 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.336318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-66f22a46-c087-49c0-a4e0-b5d2b2d95ea7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.337245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-66f22a46-c087-49c0-a4e0-b5d2b2d95ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.346117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 626/1229] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.346942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f22a46-c087-49c0-a4e0-b5d2b2d95ea7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.355428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 604/1230] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/projects => generated 367 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:20.357420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c80224-46af-4bec-987b-3029b2a28706 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.357557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f22a46-c087-49c0-a4e0-b5d2b2d95ea7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.361820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c80224-46af-4bec-987b-3029b2a28706 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.362186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c80224-46af-4bec-987b-3029b2a28706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.384328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b5c80224-46af-4bec-987b-3029b2a28706 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.385597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b5c80224-46af-4bec-987b-3029b2a28706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.434822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaee689-9f6b-4ed0-9f0b-5d84f4a9c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.435430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaee689-9f6b-4ed0-9f0b-5d84f4a9c487 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.435709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaee689-9f6b-4ed0-9f0b-5d84f4a9c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.435981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaee689-9f6b-4ed0-9f0b-5d84f4a9c487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.436641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaee689-9f6b-4ed0-9f0b-5d84f4a9c487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.438490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaee689-9f6b-4ed0-9f0b-5d84f4a9c487 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.452006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 627/1231] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:20.452006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c4d8-335a-4b6f-bc8b-06df60299017 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.452006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c4d8-335a-4b6f-bc8b-06df60299017 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.452006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393c4d8-335a-4b6f-bc8b-06df60299017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.456420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 605/1232] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.457125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c80224-46af-4bec-987b-3029b2a28706 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.469070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c80224-46af-4bec-987b-3029b2a28706 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.471233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f393c4d8-335a-4b6f-bc8b-06df60299017 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.472446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f393c4d8-335a-4b6f-bc8b-06df60299017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.473816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.474432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.474704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.475025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.475597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:20.475891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.477576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.479373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:20.480595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 628/1233] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.482034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b89a78-4109-489a-9f44-74bcfe76b91c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.482351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b89a78-4109-489a-9f44-74bcfe76b91c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.482565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b89a78-4109-489a-9f44-74bcfe76b91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.492149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 606/1234] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:20.493011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.503348 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f2b89a78-4109-489a-9f44-74bcfe76b91c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.504344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17695e9b-bc0f-41d6-85ff-0b5c61339f91 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.504540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f2b89a78-4109-489a-9f44-74bcfe76b91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.509738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b26c7-c5d3-4e31-b727-57f98688cdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.510355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b26c7-c5d3-4e31-b727-57f98688cdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.510637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b26c7-c5d3-4e31-b727-57f98688cdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.510908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b26c7-c5d3-4e31-b727-57f98688cdd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.511528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b26c7-c5d3-4e31-b727-57f98688cdd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:20.511918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b26c7-c5d3-4e31-b727-57f98688cdd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.513029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 629/1235] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.513617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b26c7-c5d3-4e31-b727-57f98688cdd5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.513877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b89a78-4109-489a-9f44-74bcfe76b91c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.523457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b89a78-4109-489a-9f44-74bcfe76b91c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.533760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 607/1236] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:20.533760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ce6a-a37d-4121-b8de-6f45196e2628 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.534087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.534214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ce6a-a37d-4121-b8de-6f45196e2628 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.534214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437ce6a-a37d-4121-b8de-6f45196e2628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.534402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.534402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.534402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.534402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.534402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.548594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3437ce6a-a37d-4121-b8de-6f45196e2628 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.549950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3437ce6a-a37d-4121-b8de-6f45196e2628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.556311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 630/1237] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/users => generated 284 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:20.557115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.560352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 608/1238] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.561870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05df1-f386-4db0-a060-77f957408cb0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.562216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05df1-f386-4db0-a060-77f957408cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.562499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05df1-f386-4db0-a060-77f957408cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.575733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd7372-f8e1-4080-a854-d0ad166dd579 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.580820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.581655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.581939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.582209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] PATH_INFO: `/v3/projects/7f07a2ab12d349b6a5b422f1c9264889/users/463a0804f17940e4816ab7d984e52a74/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.582574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f3e05df1-f386-4db0-a060-77f957408cb0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.583755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f3e05df1-f386-4db0-a060-77f957408cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.591794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 609/1239] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.593062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a5b9-7490-4eab-b2b0-a77dae1d4dcf None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.593352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a5b9-7490-4eab-b2b0-a77dae1d4dcf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.593672 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420a5b9-7490-4eab-b2b0-a77dae1d4dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.594382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:20.598655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f07a2ab12d349b6a5b422f1c9264889, user_id=463a0804f17940e4816ab7d984e52a74, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.602107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.613871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3420a5b9-7490-4eab-b2b0-a77dae1d4dcf None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.615068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3420a5b9-7490-4eab-b2b0-a77dae1d4dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.616450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 631/1240] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:20 2022] PUT /identity/v3/projects/7f07a2ab12d349b6a5b422f1c9264889/users/463a0804f17940e4816ab7d984e52a74/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:20.617373 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.676289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 610/1241] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.677632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18975b-0550-4621-8419-81e845d67597 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.677896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18975b-0550-4621-8419-81e845d67597 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.678188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18975b-0550-4621-8419-81e845d67597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.685340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbebe9-8c1f-4434-b3f3-3b5cc9f89d55 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.690351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.691029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.691253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.691513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.692143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.693169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:57:20.693169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:57:20.693169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:57:20.694390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.699709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5b18975b-0550-4621-8419-81e845d67597 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.701032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5b18975b-0550-4621-8419-81e845d67597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.709147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 611/1242] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.709979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18975b-0550-4621-8419-81e845d67597 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.722587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18975b-0550-4621-8419-81e845d67597 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.729138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa6641-64f5-4b38-af0c-b81da950d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.729829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa6641-64f5-4b38-af0c-b81da950d1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.730093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa6641-64f5-4b38-af0c-b81da950d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.730360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa6641-64f5-4b38-af0c-b81da950d1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.730515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 632/1243] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:20.730989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa6641-64f5-4b38-af0c-b81da950d1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.731498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.733117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa6641-64f5-4b38-af0c-b81da950d1d8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.767012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 612/1244] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:20.767012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c3c73-8d34-4395-97f3-49adf5c6b79e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.767012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c3c73-8d34-4395-97f3-49adf5c6b79e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.767012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c3c73-8d34-4395-97f3-49adf5c6b79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.784670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0e4c3c73-8d34-4395-97f3-49adf5c6b79e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.785915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0e4c3c73-8d34-4395-97f3-49adf5c6b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.797253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458741d-4bd9-4504-925a-2d8842343804 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.850045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 613/1245] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.851114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c3c73-8d34-4395-97f3-49adf5c6b79e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.855539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2d638-c09b-4590-b636-195bf53dff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.856355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d638-c09b-4590-b636-195bf53dff6a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.856628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d638-c09b-4590-b636-195bf53dff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.856897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d638-c09b-4590-b636-195bf53dff6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.857565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2d638-c09b-4590-b636-195bf53dff6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.859211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2d638-c09b-4590-b636-195bf53dff6a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.860628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c3c73-8d34-4395-97f3-49adf5c6b79e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.865314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.865936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.866246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.866519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.867156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:20.867455 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.869049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.869508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 633/1246] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:20.870867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2385-110f-4ab1-9fae-c1ea44f3754b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.871270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2385-110f-4ab1-9fae-c1ea44f3754b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.871543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea2385-110f-4ab1-9fae-c1ea44f3754b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.883929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 614/1247] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:20.884987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.894584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b276c-c65d-4a32-b0d1-e8f9c91fe90e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.896865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-aeea2385-110f-4ab1-9fae-c1ea44f3754b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:20.898147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-aeea2385-110f-4ab1-9fae-c1ea44f3754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:20.899498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.900090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.900365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.900638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.901273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:20.901604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.903197 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.905867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 634/1248] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:20.910046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2385-110f-4ab1-9fae-c1ea44f3754b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.916246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 615/1249] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:20.917055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.926625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a8c74-61f6-45d0-b678-d2d56327e246 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.927259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea2385-110f-4ab1-9fae-c1ea44f3754b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.931143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.931761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.932022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.932225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.932319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.932642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.932921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.933023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.933196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.934025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:20.934420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.934905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.936092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.943725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:20.947245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:20.957641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 635/1250] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:20.957641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.961489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 616/1251] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:20.963200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:20.967902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f529d8-55e6-4880-bbd7-e79540cd5f72 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.972474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.973144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.973345 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.973646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.973823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a85ee1-a84a-444c-a9dd-863d0b7a0e28 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:20.974270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.976249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.978420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:20.979012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:20.979293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:20.979563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:20.980198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:20.980500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:20.982132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:20.994706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 617/1252] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:20.995654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.003295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 636/1253] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:20 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.003295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.011628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d10fb-52d3-47c3-8afc-7b516e240a1f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.011953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358b740-71b2-488a-9e2c-ad4efbe3789a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.016131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.016484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.016727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.016999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.017139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.017267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.017410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.017628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.017925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.018255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.019534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.020153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.029601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 618/1254] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.030392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.060219 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 637/1255] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.065196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.085087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc5e56-84de-4daa-bb09-d65e115bb147 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.124939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9168-9f8c-4789-932b-107874e3105c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.129613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.130204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.130483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.130756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.131393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.133181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.133741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.133863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.134191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.134490 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.143854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.145483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.156219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 619/1256] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:21.157030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.163101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 638/1257] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.166278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d70789-4a8e-4c97-8c9b-bdfcc2dc75ec service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.167173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.237734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.238271 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.238542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.238813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.239283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327e8a-4bdf-429f-a39e-4651b2d181c4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.239449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.241371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.244314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.244939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.245212 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.245506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.246156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.248045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.261632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 639/1258] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.261632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.272802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17252aa-0ac0-4c6a-b884-9048849bcdcf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.275716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 620/1259] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.276403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.281229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.281946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.282757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.283095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.283796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.285819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.297254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:21.319306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 640/1260] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.320189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.344709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:21.357229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2c1bf-6d8c-49ea-9d58-58f1e48b073d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.398927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b92fb-e42a-413b-8df5-b8561db07e0d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.404158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.404858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.405137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.405413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] PATH_INFO: `/v3/projects/24d6da08788e4a2986c3094f8e5c74ba/users/150f5d6d264c4d1c8926d2100b021fdf/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.423141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d6da08788e4a2986c3094f8e5c74ba, user_id=150f5d6d264c4d1c8926d2100b021fdf, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.424880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.425836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.426082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.426343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.426765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.427507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.429522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.445194 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 621/1261] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.445194 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.445536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 641/1262] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:21 2022] PUT /identity/v3/projects/24d6da08788e4a2986c3094f8e5c74ba/users/150f5d6d264c4d1c8926d2100b021fdf/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:21.445536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.462453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251675-7939-4fed-a378-bb2cc94f6828 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.525263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4b8be-9a29-4315-9a9c-db7dc34d0741 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.533408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.534098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.534375 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.534651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.535361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.537407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.539690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.540497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.540777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.541053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.541803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.544242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.576228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 622/1263] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.576228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.583751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 642/1264] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.583751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.586362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de024-2862-474e-8fa8-ae8805559754 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.592757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.592939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.593293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.594176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.594939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.596941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.599150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db9b3a-5de7-4f3d-b4e5-1f4f4ce9c81b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.608098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.609103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.610131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.610695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.612508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.612828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 623/1265] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.613847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.614769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.624827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e15d6-4031-4d6f-9612-bc15da83c596 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.633973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcaa30-0916-4e95-96f6-52f4377c18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.635936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcaa30-0916-4e95-96f6-52f4377c18bb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.636416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcaa30-0916-4e95-96f6-52f4377c18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.636965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcaa30-0916-4e95-96f6-52f4377c18bb admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.637967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcaa30-0916-4e95-96f6-52f4377c18bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.639944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 643/1266] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/users => generated 287 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.640759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcaa30-0916-4e95-96f6-52f4377c18bb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.647050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.665487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ea004-a463-492b-b467-925bc9960d89 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.671283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.672134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.672536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.672867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.673675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.675603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.680374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 624/1267] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/users => generated 292 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:21.682643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433986-bda0-4b8c-9861-fbcf93254239 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.683206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433986-bda0-4b8c-9861-fbcf93254239 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.683873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44433986-bda0-4b8c-9861-fbcf93254239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.693618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 644/1268] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.693618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.707875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b00ea-1003-41ed-b326-99729b1be371 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.712753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.713500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.713770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.714039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.715340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.716977 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.728014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 645/1269] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.731037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.734356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-44433986-bda0-4b8c-9861-fbcf93254239 None None] MFA Rules not processed for user `150f5d6d264c4d1c8926d2100b021fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:21.736091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-44433986-bda0-4b8c-9861-fbcf93254239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:21.742734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab1483-b56a-432b-b565-a086a3496e1a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.745184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:21.750118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.750737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.751014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.751284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.751927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.753608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.764700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 646/1270] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.764700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.777024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a1af5-190e-495b-b8b9-bc4112a9b588 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.782821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.783490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.783767 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.784440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] PATH_INFO: `/v3/projects/26bbd6df389949d0813c99f7c94a696d/users/e2da9a7ca37b4010a65e088515adcc57/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.801215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=26bbd6df389949d0813c99f7c94a696d, user_id=e2da9a7ca37b4010a65e088515adcc57, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.804062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.817046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 625/1271] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:21.817046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433986-bda0-4b8c-9861-fbcf93254239 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.830151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44433986-bda0-4b8c-9861-fbcf93254239 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.833324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 647/1272] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:21 2022] PUT /identity/v3/projects/26bbd6df389949d0813c99f7c94a696d/users/e2da9a7ca37b4010a65e088515adcc57/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:21.834275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.854874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:21.901715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.902477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.902754 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.903021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.903832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.905618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.907613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b75e-712c-40b7-b619-55c1d06ff6af admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.912781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.913454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.913851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.914183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.914893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.919616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 626/1273] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.919790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.919899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.927303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc50271-19ac-4a14-b12b-995defb44be7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.931576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 648/1274] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.932588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.936783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.937632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.937960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.938299 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] PATH_INFO: `/v3/projects/24f97b4a7d55499da6023b8ba5951870/users/d4967aae8aa544d0b3da824976e0d9c4/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.946263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dea13-f9aa-4922-a850-d0af9ec8ffa9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.953417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:21.954269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:21.954734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:21.955155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:21.956003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.958093 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.965983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f97b4a7d55499da6023b8ba5951870, user_id=d4967aae8aa544d0b3da824976e0d9c4, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:21.969050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:21.969941 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 649/1275] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:21.973482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:21.988595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f0fca-2b97-420d-ac1d-46e5d0f5799d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:21.989275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 627/1276] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:21 2022] PUT /identity/v3/projects/24f97b4a7d55499da6023b8ba5951870/users/d4967aae8aa544d0b3da824976e0d9c4/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:21.994275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.076215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acef84e-57a6-47bb-ad57-c3080121d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.076807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8a5cf-6afa-4a85-a5f5-20a932957325 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.078098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef84e-57a6-47bb-ad57-c3080121d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.078496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef84e-57a6-47bb-ad57-c3080121d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.078817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acef84e-57a6-47bb-ad57-c3080121d0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.079552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef84e-57a6-47bb-ad57-c3080121d0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.081504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.081826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acef84e-57a6-47bb-ad57-c3080121d0e2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.082373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.082764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.083224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.096969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 650/1277] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:22.098794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af065-d00e-4fb9-8a59-51d712fd1c47 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.099240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af065-d00e-4fb9-8a59-51d712fd1c47 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.099667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3af065-d00e-4fb9-8a59-51d712fd1c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.122861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7e3af065-d00e-4fb9-8a59-51d712fd1c47 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:22.124253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7e3af065-d00e-4fb9-8a59-51d712fd1c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:22.128049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:22.133918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 651/1278] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:22.134882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3af065-d00e-4fb9-8a59-51d712fd1c47 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.147082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3af065-d00e-4fb9-8a59-51d712fd1c47 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.152275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.153038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.153481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.153890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.154755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.156508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.166360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.168159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.172706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 652/1279] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:22.172706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.185403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e71238-1955-468e-b7b1-8017b164da55 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.193074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc764b16-0a74-4f8c-a93f-442e4ec45a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.194973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764b16-0a74-4f8c-a93f-442e4ec45a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.195466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764b16-0a74-4f8c-a93f-442e4ec45a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.195645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 628/1280] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:22.195855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764b16-0a74-4f8c-a93f-442e4ec45a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.197055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.197541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc764b16-0a74-4f8c-a93f-442e4ec45a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.200134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc764b16-0a74-4f8c-a93f-442e4ec45a6b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.216143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 653/1281] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:22.216563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e685a-940a-417d-9b27-ede1a3c48d57 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.222131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56537a4-14d8-4bab-b00e-9fa30852317c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.224325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.225279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.225756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.226294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] PATH_INFO: `/v3/projects/306741a419074ac294de16c60ff5cf57/users/df9070301e814527a887aee5c266226f/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.226412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56537a4-14d8-4bab-b00e-9fa30852317c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.229596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56537a4-14d8-4bab-b00e-9fa30852317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.250561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306741a419074ac294de16c60ff5cf57, user_id=df9070301e814527a887aee5c266226f, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.253573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.269258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 629/1282] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:22 2022] PUT /identity/v3/projects/306741a419074ac294de16c60ff5cf57/users/df9070301e814527a887aee5c266226f/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:22.269962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.276682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d56537a4-14d8-4bab-b00e-9fa30852317c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:22.279878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d56537a4-14d8-4bab-b00e-9fa30852317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:22.367292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cb4a0-7d19-47c2-b618-a2c77e767eb9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.373309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.374483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.374483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.374920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] PATH_INFO: `/v3/projects/0ebdcf0ac92a40a3ba8444d5482e48cf/users/584b959cf2224df5b526dfb6c45a7fe1/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.376889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 654/1283] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:22.390409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56537a4-14d8-4bab-b00e-9fa30852317c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.394154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ebdcf0ac92a40a3ba8444d5482e48cf, user_id=584b959cf2224df5b526dfb6c45a7fe1, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.398186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.405149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:22.424211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 630/1284] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:22 2022] PUT /identity/v3/projects/0ebdcf0ac92a40a3ba8444d5482e48cf/users/584b959cf2224df5b526dfb6c45a7fe1/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:22.424211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.485252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56537a4-14d8-4bab-b00e-9fa30852317c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.547581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a142d4ab-aca9-4ebf-b3d3-61de130afcc2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.561311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca3975-e522-4177-81ed-7f67ba859c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.562031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca3975-e522-4177-81ed-7f67ba859c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.562314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca3975-e522-4177-81ed-7f67ba859c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.562449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.562584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca3975-e522-4177-81ed-7f67ba859c3f admin admin] PATH_INFO: `/v3/projects/f5a6041198e14ee0be4f4552af57e24a/users/2c5bc0f064274b22bb088b5e196aca9b/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.563430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.563805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.564175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.579647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.583864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.601328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca3975-e522-4177-81ed-7f67ba859c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a6041198e14ee0be4f4552af57e24a, user_id=2c5bc0f064274b22bb088b5e196aca9b, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.604410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca3975-e522-4177-81ed-7f67ba859c3f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.614968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 655/1285] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:22.616616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.629359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 631/1286] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:22 2022] PUT /identity/v3/projects/f5a6041198e14ee0be4f4552af57e24a/users/2c5bc0f064274b22bb088b5e196aca9b/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:22.642216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24542bc-bba7-456e-9ccc-31b2e292c7ed None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.642501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24542bc-bba7-456e-9ccc-31b2e292c7ed None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.642779 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24542bc-bba7-456e-9ccc-31b2e292c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.645197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319af62-9f5f-4e7a-8127-35da2f986e66 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.687222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a24542bc-bba7-456e-9ccc-31b2e292c7ed None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:22.693246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a24542bc-bba7-456e-9ccc-31b2e292c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:22.726132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:22.807711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33affe58-0b2c-4345-9833-b470e7d264cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:22.808609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe58-0b2c-4345-9833-b470e7d264cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.810128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe58-0b2c-4345-9833-b470e7d264cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.810674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33affe58-0b2c-4345-9833-b470e7d264cb admin admin] PATH_INFO: `/v3/projects/d66e296b11324307b49ab57ddba41513/users/c65f42046cb74bb49da1c05983ced1b5/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.840786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 632/1287] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:22.841937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24542bc-bba7-456e-9ccc-31b2e292c7ed None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:22.857047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affe58-0b2c-4345-9833-b470e7d264cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66e296b11324307b49ab57ddba41513, user_id=c65f42046cb74bb49da1c05983ced1b5, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:22.866189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33affe58-0b2c-4345-9833-b470e7d264cb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:22.894300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 656/1288] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:22 2022] PUT /identity/v3/projects/d66e296b11324307b49ab57ddba41513/users/c65f42046cb74bb49da1c05983ced1b5/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:22.906268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5219e11-1ff1-40d7-b94e-29b0763492e1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:22.911303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5219e11-1ff1-40d7-b94e-29b0763492e1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:22.911730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5219e11-1ff1-40d7-b94e-29b0763492e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:22.962301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24542bc-bba7-456e-9ccc-31b2e292c7ed None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:22.962687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c5219e11-1ff1-40d7-b94e-29b0763492e1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:22.964935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c5219e11-1ff1-40d7-b94e-29b0763492e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:23.082083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:23.083034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.083520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.084545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.118753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:23.147312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 657/1289] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:23.149844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435c6d-36db-4127-9960-e6f034dee621 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.150232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435c6d-36db-4127-9960-e6f034dee621 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.150608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7435c6d-36db-4127-9960-e6f034dee621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.230734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f7435c6d-36db-4127-9960-e6f034dee621 None None] MFA Rules not processed for user `2c5bc0f064274b22bb088b5e196aca9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:23.232323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f7435c6d-36db-4127-9960-e6f034dee621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:23.256548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:23.258883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:23.289932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 633/1290] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:23.290769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:23.300999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae16555-ddb9-4b4b-98f0-f507e90f84c5 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:23.304872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315835a1-0d59-44cf-a089-bd8f02428211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:23.305796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315835a1-0d59-44cf-a089-bd8f02428211 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.306100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315835a1-0d59-44cf-a089-bd8f02428211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.306349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315835a1-0d59-44cf-a089-bd8f02428211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.318216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315835a1-0d59-44cf-a089-bd8f02428211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:23.319691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315835a1-0d59-44cf-a089-bd8f02428211 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:23.384140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 634/1291] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:23.384140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be95e8f-1fbb-4aca-80b1-36d325c098d3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.384140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be95e8f-1fbb-4aca-80b1-36d325c098d3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.384140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be95e8f-1fbb-4aca-80b1-36d325c098d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.385713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 658/1292] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:23.385713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7435c6d-36db-4127-9960-e6f034dee621 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:23.385995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:23.390234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7435c6d-36db-4127-9960-e6f034dee621 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:23.401056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5772976-1aa3-4287-b12c-6ef691ea7ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:23.404782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5772976-1aa3-4287-b12c-6ef691ea7ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.404782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5772976-1aa3-4287-b12c-6ef691ea7ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.404782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5772976-1aa3-4287-b12c-6ef691ea7ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.405523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9be95e8f-1fbb-4aca-80b1-36d325c098d3 None None] MFA Rules not processed for user `c65f42046cb74bb49da1c05983ced1b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:23.406880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9be95e8f-1fbb-4aca-80b1-36d325c098d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:23.424424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5772976-1aa3-4287-b12c-6ef691ea7ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:23.426522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5772976-1aa3-4287-b12c-6ef691ea7ec8 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:23.439542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 659/1293] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:23.441367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d24b9-2671-4ef0-a562-e7a79bdc9ded None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.441766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d24b9-2671-4ef0-a562-e7a79bdc9ded None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.442110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d24b9-2671-4ef0-a562-e7a79bdc9ded None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.445448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 660/1294] 10.222.0.52 () {54 vars in 961 bytes} [Fri Oct 28 19:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:57:23.465320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566490-53dc-4dc6-a6e8-3ca10039c664 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.466218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566490-53dc-4dc6-a6e8-3ca10039c664 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.466823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566490-53dc-4dc6-a6e8-3ca10039c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.528138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-60566490-53dc-4dc6-a6e8-3ca10039c664 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:23.529916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-60566490-53dc-4dc6-a6e8-3ca10039c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:23.617586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 635/1295] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:23.696221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65e7b5-90b7-4ca0-be06-6701b187b9cb None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.696907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65e7b5-90b7-4ca0-be06-6701b187b9cb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.697320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65e7b5-90b7-4ca0-be06-6701b187b9cb None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.700084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 636/1296] 10.222.0.52 () {54 vars in 961 bytes} [Fri Oct 28 19:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:57:23.714504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755717fb-c4d3-41cc-bd5d-2b9ae50e9cf9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.724340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 661/1297] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Oct 28 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:23.728094 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755717fb-c4d3-41cc-bd5d-2b9ae50e9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.728898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755717fb-c4d3-41cc-bd5d-2b9ae50e9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.739337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566490-53dc-4dc6-a6e8-3ca10039c664 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:23.774530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60566490-53dc-4dc6-a6e8-3ca10039c664 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:23.783871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:23.784596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.784874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.785199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.792243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-755717fb-c4d3-41cc-bd5d-2b9ae50e9cf9 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:23.799777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:23.801586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-755717fb-c4d3-41cc-bd5d-2b9ae50e9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:23.801750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:23.827040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 662/1298] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:23.827669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 637/1299] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Oct 28 19:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:23.836061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:23.859146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f7add-2f96-4672-a9d2-6b7e0d3e645c service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:23.880689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b31a-993b-4073-8937-feac332b0115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:23.881451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b31a-993b-4073-8937-feac332b0115 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:23.882005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b31a-993b-4073-8937-feac332b0115 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:23.882813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b31a-993b-4073-8937-feac332b0115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:23.901566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b31a-993b-4073-8937-feac332b0115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:23.905905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b31a-993b-4073-8937-feac332b0115 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:23.947594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 663/1300] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:57:24.306863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e543-cace-4779-af10-9cd4f0455054 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:24.307890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e543-cace-4779-af10-9cd4f0455054 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:24.308898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e543-cace-4779-af10-9cd4f0455054 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:24.311591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 638/1301] 10.222.0.52 () {54 vars in 912 bytes} [Fri Oct 28 19:57:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:57:24.319811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b591c3-45d1-436d-98ea-185f6ac28d80 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:24.320385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b591c3-45d1-436d-98ea-185f6ac28d80 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:24.321411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b591c3-45d1-436d-98ea-185f6ac28d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:24.355778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d4b591c3-45d1-436d-98ea-185f6ac28d80 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:24.357076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d4b591c3-45d1-436d-98ea-185f6ac28d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:24.378292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 664/1302] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:24.391772 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6e543-cace-4779-af10-9cd4f0455054 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:24.412509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ffe11-434c-456e-8e4d-7be7ea242330 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:24.412804 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ffe11-434c-456e-8e4d-7be7ea242330 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:24.413053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ffe11-434c-456e-8e4d-7be7ea242330 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:24.416696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 665/1303] 10.222.0.52 () {54 vars in 912 bytes} [Fri Oct 28 19:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:57:24.426702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41dc78-6954-4f66-8256-98580247e58d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:24.427001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41dc78-6954-4f66-8256-98580247e58d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:24.427686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41dc78-6954-4f66-8256-98580247e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:24.500298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4b41dc78-6954-4f66-8256-98580247e58d None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:24.503665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4b41dc78-6954-4f66-8256-98580247e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:24.532601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 666/1304] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 19:57:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:24.549123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41dc78-6954-4f66-8256-98580247e58d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:24.569247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:24.672636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6e543-cace-4779-af10-9cd4f0455054 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:24.685395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:24.686050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:24.686326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:24.686596 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:24.712182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:24.716947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41dc78-6954-4f66-8256-98580247e58d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:24.725628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad19e3a5-5ccb-4e4e-83f4-2e11cccecfea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:24.727461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e3a5-5ccb-4e4e-83f4-2e11cccecfea service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:24.728244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e3a5-5ccb-4e4e-83f4-2e11cccecfea service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:24.728665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19e3a5-5ccb-4e4e-83f4-2e11cccecfea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:24.740912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:24.746706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19e3a5-5ccb-4e4e-83f4-2e11cccecfea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:24.750104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad19e3a5-5ccb-4e4e-83f4-2e11cccecfea service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:24.783784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 639/1305] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:24.787061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 667/1306] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:25.523915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:25.541801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ccdaf-1f29-480c-abee-e70d90b22521 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:25.557255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:25.558101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:25.558413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:25.558852 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] PATH_INFO: `/v3/users/2c5bc0f064274b22bb088b5e196aca9b` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:25.560320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5bc0f064274b22bb088b5e196aca9b)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:25.565853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:25.697707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5bc0f064274b22bb088b5e196aca9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:25.733857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5bc0f064274b22bb088b5e196aca9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:25.734673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5bc0f064274b22bb088b5e196aca9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:25.797167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5bc0f064274b22bb088b5e196aca9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:25.800735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5bc0f064274b22bb088b5e196aca9b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:25.841041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 640/1307] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:25 2022] DELETE /identity/v3/users/2c5bc0f064274b22bb088b5e196aca9b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:25.843146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:25.843650 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:25.844107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:25.896551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:25.898639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:26.036229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 668/1308] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:26.081087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:26.082824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:26.099783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:26.207637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3e172-5b41-47ed-a9c9-0091f6ee00cf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:26.215699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881845bc-271a-44a6-950b-6f6036c795c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:26.219885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881845bc-271a-44a6-950b-6f6036c795c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:26.220433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881845bc-271a-44a6-950b-6f6036c795c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:26.220961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881845bc-271a-44a6-950b-6f6036c795c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:26.295424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881845bc-271a-44a6-950b-6f6036c795c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:26.300250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881845bc-271a-44a6-950b-6f6036c795c9 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:26.335968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 641/1309] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:27.775103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:27.776813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:27.805616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b80514-5d37-4d24-8331-366683e46a08 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:27.853359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:27.854105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:27.854387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:27.854657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] PATH_INFO: `/v3/projects/f5a6041198e14ee0be4f4552af57e24a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:27.865218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a6041198e14ee0be4f4552af57e24a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:27.875995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:28.143882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a6041198e14ee0be4f4552af57e24a', 'request_id': 'req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:28.162852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a6041198e14ee0be4f4552af57e24a', 'request_id': 'req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:28.186847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a6041198e14ee0be4f4552af57e24a', 'request_id': 'req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:28.227526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] The token cache is being invalidate because project f5a6041198e14ee0be4f4552af57e24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:28.232131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:28.235516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-59d75e1c-f5d0-48ae-bf60-7f2008a25e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:28.238353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 669/1310] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:27 2022] DELETE /identity/v3/projects/f5a6041198e14ee0be4f4552af57e24a => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:28.243746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc212b-7973-4f1d-beed-47b2a3ab55be None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:28.245556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc212b-7973-4f1d-beed-47b2a3ab55be None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:28.246082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc212b-7973-4f1d-beed-47b2a3ab55be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:28.309218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-fdbc212b-7973-4f1d-beed-47b2a3ab55be None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:28.311076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fdbc212b-7973-4f1d-beed-47b2a3ab55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:28.462312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 642/1311] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:28.470783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87208171-ba8a-42c5-9f51-1d7fb9764e57 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:28.471412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87208171-ba8a-42c5-9f51-1d7fb9764e57 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:28.471876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87208171-ba8a-42c5-9f51-1d7fb9764e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:28.517161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-87208171-ba8a-42c5-9f51-1d7fb9764e57 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:28.518986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-87208171-ba8a-42c5-9f51-1d7fb9764e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:28.548056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 670/1312] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:28.553645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc212b-7973-4f1d-beed-47b2a3ab55be None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:28.573459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc212b-7973-4f1d-beed-47b2a3ab55be None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:28.585976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:28.588976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:28.589532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:28.590023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:28.593157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:28.593532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:28.597751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:28.631814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 643/1313] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:28.636895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87208171-ba8a-42c5-9f51-1d7fb9764e57 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:28.651828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87208171-ba8a-42c5-9f51-1d7fb9764e57 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:28.671198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:28.672025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:28.672317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:28.672599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:28.673274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:28.675553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:28.746045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 671/1314] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:28 2022] POST /identity/v3/projects => generated 363 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:28.750752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:28.768111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18ca84-a5ad-45e4-a115-1a3e11769a80 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:28.883940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:28.886294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:28.889453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:28.890041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:28.891401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:28.895584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:28.970653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 644/1315] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:28 2022] POST /identity/v3/users => generated 282 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:28.975528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:28.988877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:28.993841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fda99-8562-49d1-9bd3-7a345a5b4d3e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:29.008053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:29.014933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:29.015207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:29.015483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:29.016180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:29.018186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:29.039647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 672/1316] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:29.043055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:29.058719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0d6ca6-8637-4dc9-baec-911a95989ca7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:29.070321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1016efeb-e93b-4c48-bf00-ca698baf3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:29.070874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016efeb-e93b-4c48-bf00-ca698baf3025 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:29.071153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016efeb-e93b-4c48-bf00-ca698baf3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:29.071430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1016efeb-e93b-4c48-bf00-ca698baf3025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:29.072155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016efeb-e93b-4c48-bf00-ca698baf3025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:29.073886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1016efeb-e93b-4c48-bf00-ca698baf3025 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:29.107649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 645/1317] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:29.110621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:29.125813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4012b-916a-4400-9b14-3f55a6acf755 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:29.157320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:29.158471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:29.158980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:29.159207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] PATH_INFO: `/v3/projects/3b864e0080094f31ba23ac6ce59f28d9/users/405a0305c14641bd8282bccd2369f50c/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:29.218541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b864e0080094f31ba23ac6ce59f28d9, user_id=405a0305c14641bd8282bccd2369f50c, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:29.221407 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:29.269723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 673/1318] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:29 2022] PUT /identity/v3/projects/3b864e0080094f31ba23ac6ce59f28d9/users/405a0305c14641bd8282bccd2369f50c/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:29.280176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf5947-28ef-4024-83b8-89040c544562 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:29.280759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf5947-28ef-4024-83b8-89040c544562 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:29.280759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf5947-28ef-4024-83b8-89040c544562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:29.363290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-16bf5947-28ef-4024-83b8-89040c544562 None None] MFA Rules not processed for user `405a0305c14641bd8282bccd2369f50c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:29.365038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-16bf5947-28ef-4024-83b8-89040c544562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:29.384148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:29.583386 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 646/1319] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:29.586479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:29.744074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616444e-83b8-4ba7-a94e-0a8a26e31ee0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:29.749902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:29.750995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:29.751377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:29.751750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:29.752531 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:29.754663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:29.809532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 674/1320] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:29 2022] POST /identity/v3/projects => generated 365 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:29.811223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf5947-28ef-4024-83b8-89040c544562 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:29.826187 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf5947-28ef-4024-83b8-89040c544562 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:29.999218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:30.000134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:30.001321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:30.002071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:30.002906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:30.005955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:30.045528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 647/1321] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:29 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:30.049634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:30.066855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b915a-51e1-4267-9c44-c662c40755b5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:30.090394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:30.091135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:30.091574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:30.091920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:30.095191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:30.098771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:30.130679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 675/1322] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:30.135528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:30.159014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa74f4-c211-4cf1-a193-2d49ac7405c4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:30.199501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:30.200087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:30.200368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:30.200650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] PATH_INFO: `/v3/projects/851c943ca0d1458c9d6d957a29f18b22/users/73a53a1341b2461097aa54502a98e46e/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:30.255785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851c943ca0d1458c9d6d957a29f18b22, user_id=73a53a1341b2461097aa54502a98e46e, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:30.264818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:30.295862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 648/1323] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:30 2022] PUT /identity/v3/projects/851c943ca0d1458c9d6d957a29f18b22/users/73a53a1341b2461097aa54502a98e46e/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:30.297139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:30.319705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bea945-504b-4a5f-ba0f-eecc3cba4407 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:30.791298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622896c1-35a0-4a94-b433-e2fc69a2096c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:30.792833 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622896c1-35a0-4a94-b433-e2fc69a2096c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:30.793288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622896c1-35a0-4a94-b433-e2fc69a2096c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:30.793758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622896c1-35a0-4a94-b433-e2fc69a2096c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:30.796266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622896c1-35a0-4a94-b433-e2fc69a2096c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:30.810032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622896c1-35a0-4a94-b433-e2fc69a2096c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:30.847477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 676/1324] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:30.852014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:30.879466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b39102-7590-4010-bd3d-03802bd0e0e0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:30.902183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:30.903343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:30.904069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:30.904810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] PATH_INFO: `/v3/projects/851c943ca0d1458c9d6d957a29f18b22/users/73a53a1341b2461097aa54502a98e46e/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:30.921859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851c943ca0d1458c9d6d957a29f18b22, user_id=73a53a1341b2461097aa54502a98e46e, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:30.925516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:30.966011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 649/1325] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:30 2022] PUT /identity/v3/projects/851c943ca0d1458c9d6d957a29f18b22/users/73a53a1341b2461097aa54502a98e46e/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:30.968670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2b357-7674-47ac-bbf8-58051d381375 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:30.969658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2b357-7674-47ac-bbf8-58051d381375 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:30.970341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2b357-7674-47ac-bbf8-58051d381375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:31.057699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b9b2b357-7674-47ac-bbf8-58051d381375 None None] MFA Rules not processed for user `73a53a1341b2461097aa54502a98e46e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:31.061993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b9b2b357-7674-47ac-bbf8-58051d381375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:31.145052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:31.259773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 677/1326] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:31.269157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:31.271011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:31.430035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326afb8f-fc17-4371-8b3b-105dac558d04 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:31.443091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:31.443744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:31.444022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:31.444336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:31.468112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:31.470057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:31.498703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 650/1327] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:31.706787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2b357-7674-47ac-bbf8-58051d381375 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:31.728674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2b357-7674-47ac-bbf8-58051d381375 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:31.737470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452b96-6656-4103-ac45-4ce8c41c96ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:31.738359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452b96-6656-4103-ac45-4ce8c41c96ad service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:31.738869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452b96-6656-4103-ac45-4ce8c41c96ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:31.739610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452b96-6656-4103-ac45-4ce8c41c96ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:31.900667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452b96-6656-4103-ac45-4ce8c41c96ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:31.902365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452b96-6656-4103-ac45-4ce8c41c96ad service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:31.926383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 678/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:32.310085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:32.310085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:32.313516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:32.481740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02becbd-f384-47f3-9cf7-6e3e5c27c6b9 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:32.489364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:32.490580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:32.491092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:32.491674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] PATH_INFO: `/v3/users/c65f42046cb74bb49da1c05983ced1b5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:32.493451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c65f42046cb74bb49da1c05983ced1b5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:32.495996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:32.593574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c65f42046cb74bb49da1c05983ced1b5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:32.611792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c65f42046cb74bb49da1c05983ced1b5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:32.612636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c65f42046cb74bb49da1c05983ced1b5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:32.630422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c65f42046cb74bb49da1c05983ced1b5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:32.633431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c65f42046cb74bb49da1c05983ced1b5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:32.690225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 651/1329] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:32 2022] DELETE /identity/v3/users/c65f42046cb74bb49da1c05983ced1b5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:32.695773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9974-fee3-48e1-a856-695360070d92 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:32.696669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9974-fee3-48e1-a856-695360070d92 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:32.697451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f9974-fee3-48e1-a856-695360070d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:32.730596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-968f9974-fee3-48e1-a856-695360070d92 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:32.732141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-968f9974-fee3-48e1-a856-695360070d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:32.812558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 679/1330] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:33.051200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:33.055466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:33.261353 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b131-a104-46dd-980a-979b59668a44 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:33.265644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d5577-9d7b-4309-a240-12ca6ae9762c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:33.267164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d5577-9d7b-4309-a240-12ca6ae9762c service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:33.267619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d5577-9d7b-4309-a240-12ca6ae9762c service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:33.268305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d5577-9d7b-4309-a240-12ca6ae9762c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:33.282624 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d5577-9d7b-4309-a240-12ca6ae9762c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:33.284478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d5577-9d7b-4309-a240-12ca6ae9762c service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:33.297908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 652/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:34.873457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f9974-fee3-48e1-a856-695360070d92 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:34.875382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-968f9974-fee3-48e1-a856-695360070d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:34.910128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f9974-fee3-48e1-a856-695360070d92 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:34.925357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:34.926225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:34.926808 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:34.927151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] PATH_INFO: `/v3/projects/d66e296b11324307b49ab57ddba41513` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:34.930383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66e296b11324307b49ab57ddba41513)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:34.932596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:35.102237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66e296b11324307b49ab57ddba41513', 'request_id': 'req-2295359a-b270-4486-9b95-5ded30a1f882'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.110043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66e296b11324307b49ab57ddba41513', 'request_id': 'req-2295359a-b270-4486-9b95-5ded30a1f882'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.117073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:35.155716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66e296b11324307b49ab57ddba41513', 'request_id': 'req-2295359a-b270-4486-9b95-5ded30a1f882'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.194424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] The token cache is being invalidate because project d66e296b11324307b49ab57ddba41513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:35.195050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.195964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2295359a-b270-4486-9b95-5ded30a1f882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.198129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 680/1332] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:34 2022] DELETE /identity/v3/projects/d66e296b11324307b49ab57ddba41513 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:35.203657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:35.204340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:35.204340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:35.256101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:35.267923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:35.339026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:35.471951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 653/1333] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:35.473824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d59673-03de-42e3-9c78-a3a224336842 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:35.474121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d59673-03de-42e3-9c78-a3a224336842 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:35.474465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d59673-03de-42e3-9c78-a3a224336842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:35.548172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-75d59673-03de-42e3-9c78-a3a224336842 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:35.550622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-75d59673-03de-42e3-9c78-a3a224336842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:35.584378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:35.585603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 681/1334] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:35.586753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:35.590472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d59673-03de-42e3-9c78-a3a224336842 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:35.619191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf2ebe-1d12-4316-bcc2-c2b7805725ba None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:35.627017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d59673-03de-42e3-9c78-a3a224336842 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:35.647203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:35.647921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:35.648203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:35.648477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] PATH_INFO: `/v3/users/150f5d6d264c4d1c8926d2100b021fdf` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:35.649890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:35.651063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:35.652523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:35.653146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=150f5d6d264c4d1c8926d2100b021fdf)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:35.653283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:35.655295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:35.656725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:35.657013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:35.663190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:35.691510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 682/1335] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:35.703827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:35.773866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f8a14-0f5b-422f-98dc-d85512d68e91 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:35.836180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:35.840187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:35.840867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:35.841324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:35.844703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:35.874845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:35.893684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '150f5d6d264c4d1c8926d2100b021fdf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.981252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '150f5d6d264c4d1c8926d2100b021fdf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.988701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '150f5d6d264c4d1c8926d2100b021fdf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:35.995139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 683/1336] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:35 2022] POST /identity/v3/projects => generated 373 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:36.002895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:36.017736 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:36.095031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '150f5d6d264c4d1c8926d2100b021fdf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:36.096239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-767156ed-f197-497b-bd65-36a36f8f92a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '150f5d6d264c4d1c8926d2100b021fdf'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:36.167545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 654/1337] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:35 2022] DELETE /identity/v3/users/150f5d6d264c4d1c8926d2100b021fdf => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:57:36.167545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ffb8-3af7-4617-97d0-2ae9cf700710 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:36.167545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ffb8-3af7-4617-97d0-2ae9cf700710 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:36.167545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049ffb8-3af7-4617-97d0-2ae9cf700710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:36.278352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f049ffb8-3af7-4617-97d0-2ae9cf700710 None None] MFA Rules not processed for user `df9070301e814527a887aee5c266226f`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:36.280537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f049ffb8-3af7-4617-97d0-2ae9cf700710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:36.321179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df47a160-26c8-49bf-8f46-20b4c1f82775 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:36.601559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec47c4-1974-4366-86e2-87df0539c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:36.603556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec47c4-1974-4366-86e2-87df0539c897 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:36.608139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec47c4-1974-4366-86e2-87df0539c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:36.609135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec47c4-1974-4366-86e2-87df0539c897 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:36.610276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec47c4-1974-4366-86e2-87df0539c897 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:36.634836 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec47c4-1974-4366-86e2-87df0539c897 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:36.683074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 655/1338] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:36.686728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:36.687743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:36.688985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:36.710677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 684/1339] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:35 2022] POST /identity/v3/users => generated 287 bytes in 710 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:36.710677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aeea-b320-49cd-82c6-a8df062e2e9d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:36.710677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aeea-b320-49cd-82c6-a8df062e2e9d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:36.710677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299aeea-b320-49cd-82c6-a8df062e2e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:36.769692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d299aeea-b320-49cd-82c6-a8df062e2e9d None None] MFA Rules not processed for user `df9070301e814527a887aee5c266226f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:36.773544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d299aeea-b320-49cd-82c6-a8df062e2e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:36.793726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 685/1340] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:36.794931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299aeea-b320-49cd-82c6-a8df062e2e9d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:36.812027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:36.820156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299aeea-b320-49cd-82c6-a8df062e2e9d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:36.821526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:36.825979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:36.826616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:36.826880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:36.827335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:36.828535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:36.831151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:36.853126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 656/1341] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:36.855659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:36.860487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 686/1342] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:36.866831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:36.867053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:36.912481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45808579-4c95-4fe7-8db4-f001077720bc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:36.940587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:36.946103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:36.946938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:36.950293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:36.953231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:36.960280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:36.995661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 687/1343] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:57:36.998098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:37.002245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:37.029954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:37.074393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:37.326598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df3caf-56fb-4581-9adf-368e2dc8246e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:37.329967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bdc39d-de49-4d85-acd7-614bad6cc8de None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:37.340518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fc45d-c6c9-41d9-baf5-bb407878d803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:37.345059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fc45d-c6c9-41d9-baf5-bb407878d803 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:37.356205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fc45d-c6c9-41d9-baf5-bb407878d803 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:37.356205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fc45d-c6c9-41d9-baf5-bb407878d803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:37.388813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:37.393034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:37.394327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:37.397157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:37.422724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fc45d-c6c9-41d9-baf5-bb407878d803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:37.429760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fc45d-c6c9-41d9-baf5-bb407878d803 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:37.434098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:37.440237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:37.476613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 657/1344] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:37.480342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:37.507576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 688/1345] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:37.556996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f46d2-201f-4a17-bbcb-4700ac02682e service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:37.605465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:37.607792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:37.608253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:37.625148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] PATH_INFO: `/v3/projects/2387d203d2da471ba3ed3e6ade67ffdf/users/14a34884c69f4e079e43a2c1548810db/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:37.731355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2387d203d2da471ba3ed3e6ade67ffdf, user_id=14a34884c69f4e079e43a2c1548810db, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:37.758809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:37.858713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 658/1346] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:37 2022] PUT /identity/v3/projects/2387d203d2da471ba3ed3e6ade67ffdf/users/14a34884c69f4e079e43a2c1548810db/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:37.883764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:37.884208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:37.884641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:38.037399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] MFA Rules not processed for user `14a34884c69f4e079e43a2c1548810db`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:38.049367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:38.427517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 689/1347] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:38.430117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:38.559007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:38.560592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:38.843105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf03e79-f9c8-4f4d-a466-0e45eb13d59d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:38.857068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:38.858085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:38.860560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:38.861144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] PATH_INFO: `/v3/projects/24d6da08788e4a2986c3094f8e5c74ba` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:38.870182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d6da08788e4a2986c3094f8e5c74ba)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:38.873937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:38.932601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce79a0-2977-4e9e-bf6d-760b6fe71d0c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:38.944878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:38.946540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:38.947169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:38.947787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:38.949084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:38.954696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.042637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:39.051137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d6da08788e4a2986c3094f8e5c74ba', 'request_id': 'req-d42d8827-080a-458c-99af-2e5430ced534'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.070702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d6da08788e4a2986c3094f8e5c74ba', 'request_id': 'req-d42d8827-080a-458c-99af-2e5430ced534'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.083809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 659/1348] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:38 2022] POST /identity/v3/projects => generated 373 bytes in 655 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:39.088279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.099172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d6da08788e4a2986c3094f8e5c74ba', 'request_id': 'req-d42d8827-080a-458c-99af-2e5430ced534'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.124751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] The token cache is being invalidate because project 24d6da08788e4a2986c3094f8e5c74ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:39.125867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.128960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d42d8827-080a-458c-99af-2e5430ced534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:39.133551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 690/1349] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:38 2022] DELETE /identity/v3/projects/24d6da08788e4a2986c3094f8e5c74ba => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:57:39.139326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f616233-b414-4c01-bf79-c24e370908f6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.140304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f616233-b414-4c01-bf79-c24e370908f6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.141894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f616233-b414-4c01-bf79-c24e370908f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.194029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1f616233-b414-4c01-bf79-c24e370908f6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:39.195697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1f616233-b414-4c01-bf79-c24e370908f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:39.313702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a037f-8dc4-4124-b180-a92cb6aab4dc admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.326622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.327432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.327870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.328160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.328890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.332444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.335145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 691/1350] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:39.342702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d069c-dda2-48d4-a253-5314052eff46 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.342984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d069c-dda2-48d4-a253-5314052eff46 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.343312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202d069c-dda2-48d4-a253-5314052eff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.370062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:39.379926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-202d069c-dda2-48d4-a253-5314052eff46 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:39.381554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-202d069c-dda2-48d4-a253-5314052eff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:39.395012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 660/1351] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:39 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:39.395012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.397188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:39.412984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 692/1352] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:39.417135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d069c-dda2-48d4-a253-5314052eff46 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.424810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e233cf-7335-4eef-8236-f3e8321ad0ec admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.431528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202d069c-dda2-48d4-a253-5314052eff46 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.440524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.442962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.444694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.444871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.445513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.445957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.446155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.446601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.447457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.447603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:39.449518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.449840 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.454838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.476685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 693/1353] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:39.481056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 661/1354] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:39.484015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.487720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.506567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc219d9-413b-4c03-9352-2d635459b9da admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.508066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99a980-f7e0-4413-bec3-6176a6a62094 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.516152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.517092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.517463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.517931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.519060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.521224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.521501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.522365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.522811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.523270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] PATH_INFO: `/v3/projects/e99f5cc3113e4de69f83c890d57b0b4f/users/26604493998b43a4b743b507722ba6cf/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.570034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99f5cc3113e4de69f83c890d57b0b4f, user_id=26604493998b43a4b743b507722ba6cf, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.576310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.576592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 694/1355] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:39 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:57:39.577697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.608207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 662/1356] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:39 2022] PUT /identity/v3/projects/e99f5cc3113e4de69f83c890d57b0b4f/users/26604493998b43a4b743b507722ba6cf/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:57:39.613478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.737928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1733af-051e-4a9f-936d-5d3fd048d459 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.746053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.747895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.748523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.749009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.750211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.752112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.766478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 663/1357] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:39.773815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:39.792953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8c0bf3-de2c-4680-a2f9-bd17aa038345 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.798926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711a47-2e74-4d9a-8d6c-f91c687ff3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.799934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711a47-2e74-4d9a-8d6c-f91c687ff3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.800484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711a47-2e74-4d9a-8d6c-f91c687ff3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.801336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711a47-2e74-4d9a-8d6c-f91c687ff3eb admin admin] PATH_INFO: `/v3/projects/e99f5cc3113e4de69f83c890d57b0b4f/users/26604493998b43a4b743b507722ba6cf/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.803766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711a47-2e74-4d9a-8d6c-f91c687ff3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99f5cc3113e4de69f83c890d57b0b4f, user_id=26604493998b43a4b743b507722ba6cf, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.808362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711a47-2e74-4d9a-8d6c-f91c687ff3eb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:39.847142 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 664/1358] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:39 2022] PUT /identity/v3/projects/e99f5cc3113e4de69f83c890d57b0b4f/users/26604493998b43a4b743b507722ba6cf/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:39.849131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bfc9a-c84f-4158-862e-e507f0d3aa8d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.849131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bfc9a-c84f-4158-862e-e507f0d3aa8d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.849328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bfc9a-c84f-4158-862e-e507f0d3aa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.858385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473cdd5-cc82-4fc4-9d60-3f36e46d9d3c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:39.889101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d01bfc9a-c84f-4158-862e-e507f0d3aa8d None None] MFA Rules not processed for user `26604493998b43a4b743b507722ba6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:39.890449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d01bfc9a-c84f-4158-862e-e507f0d3aa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:39.928028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:39.960558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:39.961848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:39.962119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:39.962702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:39.964188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:39.968228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.021745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 695/1359] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:39 2022] POST /identity/v3/users => generated 282 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:40.027673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.039934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc92a0d-ced1-4fd6-ba8a-80304188bd5f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.047810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.049361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.049979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.050492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.051645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.054689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.073223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 665/1360] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:40.075989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 696/1361] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:40.084238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bfc9a-c84f-4158-862e-e507f0d3aa8d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.098260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.101458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:40.109209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bfc9a-c84f-4158-862e-e507f0d3aa8d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.124812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.125946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.126501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.126987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.128287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.132332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.159955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 666/1362] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:40.162387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.183671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe98d8b-298d-4931-8251-c656e8a991b6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.196333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc790eee-8ca1-4cfb-91e7-0bcf2e029531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.196897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790eee-8ca1-4cfb-91e7-0bcf2e029531 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.197246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790eee-8ca1-4cfb-91e7-0bcf2e029531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.197757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790eee-8ca1-4cfb-91e7-0bcf2e029531 admin admin] PATH_INFO: `/v3/projects/f8b841b0380445e7be7469343473cdaf/users/3b4e9667d72a49078f9533042a8d14c2/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.239530 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc790eee-8ca1-4cfb-91e7-0bcf2e029531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b841b0380445e7be7469343473cdaf, user_id=3b4e9667d72a49078f9533042a8d14c2, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.244927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e211d-be5e-435e-aba9-312f8ea0eb15 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.252015 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc790eee-8ca1-4cfb-91e7-0bcf2e029531 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.255139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.256053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.257521 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.258045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.259298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:40.294180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.295687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.319114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 667/1363] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:40 2022] PUT /identity/v3/projects/f8b841b0380445e7be7469343473cdaf/users/3b4e9667d72a49078f9533042a8d14c2/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:40.330315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06570e-8b0e-47ea-bc9c-a0577e96dbdf None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.330770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06570e-8b0e-47ea-bc9c-a0577e96dbdf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.341901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06570e-8b0e-47ea-bc9c-a0577e96dbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.358519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 697/1364] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:40.433004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1b06570e-8b0e-47ea-bc9c-a0577e96dbdf None None] MFA Rules not processed for user `3b4e9667d72a49078f9533042a8d14c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:40.439499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1b06570e-8b0e-47ea-bc9c-a0577e96dbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:40.504889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.525605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507c799-94b8-4a1b-a040-586a1234e036 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:40.655773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:40.656502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.656768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.657040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.661197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:40.722823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 668/1365] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:40.724167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53bd83-a079-48b1-8b6c-b9de62084c73 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.724454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53bd83-a079-48b1-8b6c-b9de62084c73 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.724731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53bd83-a079-48b1-8b6c-b9de62084c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.819283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6c53bd83-a079-48b1-8b6c-b9de62084c73 None None] MFA Rules not processed for user `463a0804f17940e4816ab7d984e52a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:40.821093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6c53bd83-a079-48b1-8b6c-b9de62084c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:40.850048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:40.851810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:40.893155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 698/1366] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:40.898742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.966822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 669/1367] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:40.966822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decd7-1f0d-4556-a12d-09fc4c3657fc None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:40.966822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decd7-1f0d-4556-a12d-09fc4c3657fc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:40.966822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1decd7-1f0d-4556-a12d-09fc4c3657fc None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:40.968229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:40.974734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 670/1368] 10.222.0.52 () {54 vars in 912 bytes} [Fri Oct 28 19:57:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:57:40.976068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decd7-1f0d-4556-a12d-09fc4c3657fc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:40.979409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ae1decd7-1f0d-4556-a12d-09fc4c3657fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:41.111766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57a5cc-c49b-4143-9745-65c45d721fdc service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.150395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199175d-19f7-47ad-bc18-df9b76c913de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.151285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199175d-19f7-47ad-bc18-df9b76c913de admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.151654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199175d-19f7-47ad-bc18-df9b76c913de admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.151929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199175d-19f7-47ad-bc18-df9b76c913de admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.153285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199175d-19f7-47ad-bc18-df9b76c913de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.161280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199175d-19f7-47ad-bc18-df9b76c913de admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.218282 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1decd7-1f0d-4556-a12d-09fc4c3657fc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.231810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.231810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.231810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.231810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.255320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.259658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 699/1369] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:40 2022] POST /identity/v3/projects => generated 363 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:41.259824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.261243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.261617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.264115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.265063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:41.288742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 671/1370] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:41.289788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.306737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4883212-1adf-4b9d-8c20-985801dddb62 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.397057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] MFA Rules not processed for user `7157e60fb6fb4b84866ce59f051a9037`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:41.399919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:41.446627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.447273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.449901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.450254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.452568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.457083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.524785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 672/1371] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:41 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:41.526212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.550620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 700/1372] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 19:57:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:41.557100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d08a43-f24a-48c3-8b79-a32ef282ea39 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.571059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.572190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.572891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.573356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.576419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.582112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.583887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:41.584820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.616194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2200b-3cc5-4a2d-9d3c-358547b27b0b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.622702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 673/1373] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:57:41.624417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.637918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.649530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.650052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.650483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.650845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e7d04-2f13-47d6-9a24-f462aa521ad9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:41.674927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:41.676446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:41.676884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:41.678511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] PATH_INFO: `/v3/projects/2db63d5b366e41b8bfb0951f857289b5/users/e4db48bf290f46c9bbe24495c6fce639/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:41.705046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.717094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.721919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db63d5b366e41b8bfb0951f857289b5, user_id=e4db48bf290f46c9bbe24495c6fce639, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:41.729926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:41.764613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 701/1374] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:41.769868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 674/1375] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:41 2022] PUT /identity/v3/projects/2db63d5b366e41b8bfb0951f857289b5/users/e4db48bf290f46c9bbe24495c6fce639/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:41.777053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:41.823952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be2d11-3c42-4767-b721-aa6f142327a2 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.060771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bad975-7c94-4ed3-a2ab-537fb76ee236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.061848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad975-7c94-4ed3-a2ab-537fb76ee236 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.062333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad975-7c94-4ed3-a2ab-537fb76ee236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.063536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bad975-7c94-4ed3-a2ab-537fb76ee236 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.064248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bad975-7c94-4ed3-a2ab-537fb76ee236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.080446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bad975-7c94-4ed3-a2ab-537fb76ee236 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.112722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 702/1376] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:42.121201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:42.181099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4644b-1dfa-46ed-b165-65c038306d3d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.202600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.205261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.206073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.206574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] PATH_INFO: `/v3/projects/2db63d5b366e41b8bfb0951f857289b5/users/e4db48bf290f46c9bbe24495c6fce639/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.210789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db63d5b366e41b8bfb0951f857289b5, user_id=e4db48bf290f46c9bbe24495c6fce639, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.220929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.313508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 675/1377] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:42 2022] PUT /identity/v3/projects/2db63d5b366e41b8bfb0951f857289b5/users/e4db48bf290f46c9bbe24495c6fce639/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:42.318947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e3b0-aeee-4564-85d7-77ed6b657473 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.319736 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e3b0-aeee-4564-85d7-77ed6b657473 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.320467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279e3b0-aeee-4564-85d7-77ed6b657473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.388588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0279e3b0-aeee-4564-85d7-77ed6b657473 None None] MFA Rules not processed for user `e4db48bf290f46c9bbe24495c6fce639`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:42.390767 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0279e3b0-aeee-4564-85d7-77ed6b657473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:42.407529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:42.565715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:42.567989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:42.591104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 703/1378] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:42.605283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e3b0-aeee-4564-85d7-77ed6b657473 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:42.743712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f7aa-6e4f-41e5-bcbe-bcf78fd108ac admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.756284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.758257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.758257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.758257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] PATH_INFO: `/v3/users/405a0305c14641bd8282bccd2369f50c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.759962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405a0305c14641bd8282bccd2369f50c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.762402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.782682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279e3b0-aeee-4564-85d7-77ed6b657473 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:42.797129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87c3ca-b60f-44df-b6f9-8c4e109558f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:42.799314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87c3ca-b60f-44df-b6f9-8c4e109558f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:42.801282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87c3ca-b60f-44df-b6f9-8c4e109558f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:42.802511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87c3ca-b60f-44df-b6f9-8c4e109558f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:42.840236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87c3ca-b60f-44df-b6f9-8c4e109558f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:42.849838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87c3ca-b60f-44df-b6f9-8c4e109558f7 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:42.885507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 704/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:42.934515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:42.954070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405a0305c14641bd8282bccd2369f50c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.981100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405a0305c14641bd8282bccd2369f50c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:42.986651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405a0305c14641bd8282bccd2369f50c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.009412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405a0305c14641bd8282bccd2369f50c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.010946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405a0305c14641bd8282bccd2369f50c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:43.065502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 676/1380] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:42 2022] DELETE /identity/v3/users/405a0305c14641bd8282bccd2369f50c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:43.070149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.070547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.070964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.123404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:43.129780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:43.403039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 705/1381] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:43.468245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:43.469848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:43.729624 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0da014-2ae3-428c-b187-736d9b63d181 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:43.735844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:43.736492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:43.736824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:43.737024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:43.748577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:43.750635 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:43.776929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 677/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:44.066300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.075501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.142378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.144769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.182449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0b8e6-243c-43ee-94f9-ec52de50e7a9 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:44.216542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:44.218075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.218507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.229303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] PATH_INFO: `/v3/users/3b4e9667d72a49078f9533042a8d14c2` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.244245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4e9667d72a49078f9533042a8d14c2)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:44.244393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:44.259214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:44.288657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43d116-80c7-4694-9bf2-ee55f997ad9d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:44.303854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7102fc-f7bf-4b3f-a9de-cf8fc763b79d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:44.304944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7102fc-f7bf-4b3f-a9de-cf8fc763b79d service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.305500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7102fc-f7bf-4b3f-a9de-cf8fc763b79d service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.305996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7102fc-f7bf-4b3f-a9de-cf8fc763b79d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.310368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fb7102fc-f7bf-4b3f-a9de-cf8fc763b79d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.353988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7102fc-f7bf-4b3f-a9de-cf8fc763b79d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:44.357009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7102fc-f7bf-4b3f-a9de-cf8fc763b79d service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:44.383117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 706/1383] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:44.451539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b92b-3bf3-43d8-aaf6-e11ae25ee97c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.451968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b92b-3bf3-43d8-aaf6-e11ae25ee97c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.452657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80b92b-3bf3-43d8-aaf6-e11ae25ee97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.480293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4e9667d72a49078f9533042a8d14c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.547645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4e9667d72a49078f9533042a8d14c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.548447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bd80b92b-3bf3-43d8-aaf6-e11ae25ee97c None None] MFA Rules not processed for user `e2da9a7ca37b4010a65e088515adcc57`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:44.550823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bd80b92b-3bf3-43d8-aaf6-e11ae25ee97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.552612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4e9667d72a49078f9533042a8d14c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.585374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4e9667d72a49078f9533042a8d14c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.586485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4e8db71e-0803-46e6-abae-14feb013bf71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4e9667d72a49078f9533042a8d14c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:44.631228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 678/1384] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:44 2022] DELETE /identity/v3/users/3b4e9667d72a49078f9533042a8d14c2 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:44.637536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.638643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.640955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.707399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 707/1385] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:44.708894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:44.709314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:44.709686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:44.734439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] MFA Rules not processed for user `df9070301e814527a887aee5c266226f`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:44.737002 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.766797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:44.771803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:44.849009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:44.963636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 708/1386] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:44.964675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:44.967447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 679/1387] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:44.970627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:45.122947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.125018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:45.324242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2eef6-ec2b-443c-8274-de87e69bc515 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.344919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.347185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.348634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.349921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.369993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219b574-de1f-47f9-a693-8128fa2edb80 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.377050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.391053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.404931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 680/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:45.406310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:45.407353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.408295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.408562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.408837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.413806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:45.427029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:45.432841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a9f88b-dadf-41b3-b127-b329bb57610f service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:45.463761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:45.464603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:45.464953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:45.465295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] PATH_INFO: `/v3/projects/3b864e0080094f31ba23ac6ce59f28d9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:45.471119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b864e0080094f31ba23ac6ce59f28d9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.472485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: WARNING py.warnings [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:57:45.472485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: warnings.warn(msg) Oct 28 19:57:45.472485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: Oct 28 19:57:45.474064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.591533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:45.607280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:45.638301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 709/1389] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:45.794734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b864e0080094f31ba23ac6ce59f28d9', 'request_id': 'req-ab1996ab-a21f-4348-b712-bcee01d2b565'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:45.844344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b864e0080094f31ba23ac6ce59f28d9', 'request_id': 'req-ab1996ab-a21f-4348-b712-bcee01d2b565'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:45.888807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b864e0080094f31ba23ac6ce59f28d9', 'request_id': 'req-ab1996ab-a21f-4348-b712-bcee01d2b565'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:45.954338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] The token cache is being invalidate because project 3b864e0080094f31ba23ac6ce59f28d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:45.954338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:45.957866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1996ab-a21f-4348-b712-bcee01d2b565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:45.965054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 681/1390] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:45 2022] DELETE /identity/v3/projects/3b864e0080094f31ba23ac6ce59f28d9 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:45.966532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:46.001575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb09066-6098-4c6d-bb7d-62a2982679a7 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:46.141125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:46.142113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:46.143715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:46.144200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] PATH_INFO: `/v3/users/73a53a1341b2461097aa54502a98e46e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:46.147028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a53a1341b2461097aa54502a98e46e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:46.148701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: WARNING py.warnings [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 28 19:57:46.148701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: warnings.warn(msg) Oct 28 19:57:46.148701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: Oct 28 19:57:46.150566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:46.294970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a53a1341b2461097aa54502a98e46e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:46.296566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a53a1341b2461097aa54502a98e46e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:46.296566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a53a1341b2461097aa54502a98e46e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:46.354051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a53a1341b2461097aa54502a98e46e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:46.406546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a53a1341b2461097aa54502a98e46e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:46.442615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 710/1391] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:45 2022] DELETE /identity/v3/users/73a53a1341b2461097aa54502a98e46e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:46.522537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa32a61-4834-48ce-b5cd-26bff96c3304 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:46.522882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa32a61-4834-48ce-b5cd-26bff96c3304 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:46.523100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa32a61-4834-48ce-b5cd-26bff96c3304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:46.626436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5aa32a61-4834-48ce-b5cd-26bff96c3304 None None] MFA Rules not processed for user `d4967aae8aa544d0b3da824976e0d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:46.627714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5aa32a61-4834-48ce-b5cd-26bff96c3304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:46.860940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:46.913251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 682/1392] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:46.931739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:46.937223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:46.989952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:47.060752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da127a5-4dd8-426f-89a5-3c2f1e352566 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:47.061331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da127a5-4dd8-426f-89a5-3c2f1e352566 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:47.061880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da127a5-4dd8-426f-89a5-3c2f1e352566 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:47.063817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 683/1393] 10.222.0.52 () {54 vars in 912 bytes} [Fri Oct 28 19:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:57:47.072222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:47.072914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:47.073580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:47.141641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d558211-24ab-4e3a-b427-f27376ce0a09 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:47.142626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] MFA Rules not processed for user `7157e60fb6fb4b84866ce59f051a9037`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:47.147542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:47.157807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204377c2-b247-4769-ac96-67733e80440d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:47.158465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204377c2-b247-4769-ac96-67733e80440d service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:47.160099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204377c2-b247-4769-ac96-67733e80440d service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:47.160412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204377c2-b247-4769-ac96-67733e80440d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:47.188569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204377c2-b247-4769-ac96-67733e80440d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:47.194359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204377c2-b247-4769-ac96-67733e80440d service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:47.214681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 711/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:47.570046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 684/1395] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 19:57:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:47.608332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204377c2-b247-4769-ac96-67733e80440d service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:47.610421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-204377c2-b247-4769-ac96-67733e80440d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:47.626557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204377c2-b247-4769-ac96-67733e80440d service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:47.632242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054a304-cb96-4754-8473-a7dc11ce6f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:47.633042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a304-cb96-4754-8473-a7dc11ce6f02 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:47.633489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a304-cb96-4754-8473-a7dc11ce6f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:47.633734 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054a304-cb96-4754-8473-a7dc11ce6f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:47.644618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054a304-cb96-4754-8473-a7dc11ce6f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:47.647472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054a304-cb96-4754-8473-a7dc11ce6f02 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:47.660391 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 712/1396] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:48.491638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:48.494106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:48.610308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:48.611250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:48.611526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:48.673046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db557f6d-b2c1-4bcd-9f86-bd04e3c5b205 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:48.686323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:48.687622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:48.688748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:48.689160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] PATH_INFO: `/v3/projects/f8b841b0380445e7be7469343473cdaf` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:48.692857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b841b0380445e7be7469343473cdaf)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:48.697205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:48.737034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:48.738319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:48.847071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b841b0380445e7be7469343473cdaf', 'request_id': 'req-7b02cfaa-0012-4f7c-b9f5-af944c069158'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:48.870811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b841b0380445e7be7469343473cdaf', 'request_id': 'req-7b02cfaa-0012-4f7c-b9f5-af944c069158'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:48.888135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b841b0380445e7be7469343473cdaf', 'request_id': 'req-7b02cfaa-0012-4f7c-b9f5-af944c069158'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:48.920698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] The token cache is being invalidate because project f8b841b0380445e7be7469343473cdaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:48.923895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:48.924931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:48.927024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 685/1397] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:48 2022] DELETE /identity/v3/projects/f8b841b0380445e7be7469343473cdaf => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:48.931551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:48.939061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:48.943895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 713/1398] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 19:57:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:49.102242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:49.262694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b02cfaa-0012-4f7c-b9f5-af944c069158 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:49.268000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:49.272136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:49.319836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:49.320075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:49.320373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:49.320545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] PATH_INFO: `/v3/users/e4db48bf290f46c9bbe24495c6fce639` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:49.324157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4db48bf290f46c9bbe24495c6fce639)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:49.326340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:49.454042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4db48bf290f46c9bbe24495c6fce639'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:49.490973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4db48bf290f46c9bbe24495c6fce639'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:49.491858 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4db48bf290f46c9bbe24495c6fce639'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:49.510025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4db48bf290f46c9bbe24495c6fce639'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:49.512410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4db48bf290f46c9bbe24495c6fce639'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:49.515979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:49.573501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 686/1399] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:48 2022] DELETE /identity/v3/users/e4db48bf290f46c9bbe24495c6fce639 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:49.574638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:49.582304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:49.602843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9517f6fc-0773-4681-b7af-0a9310362d59 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:49.818330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d532b7-3478-4a73-8e21-fe9be7123014 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:49.825075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0ed77-56f6-442d-8ff3-daaafac8e640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:49.827698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ed77-56f6-442d-8ff3-daaafac8e640 service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:49.831911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ed77-56f6-442d-8ff3-daaafac8e640 service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:49.834974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0ed77-56f6-442d-8ff3-daaafac8e640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:49.860176 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f2c0ed77-56f6-442d-8ff3-daaafac8e640 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:49.870575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:49.874303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:49.874587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:49.874872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] PATH_INFO: `/v3/projects/851c943ca0d1458c9d6d957a29f18b22` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:49.893575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851c943ca0d1458c9d6d957a29f18b22)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:49.896138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:50.001169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851c943ca0d1458c9d6d957a29f18b22', 'request_id': 'req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:50.052345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851c943ca0d1458c9d6d957a29f18b22', 'request_id': 'req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:50.063655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:50.094817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851c943ca0d1458c9d6d957a29f18b22', 'request_id': 'req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:50.139033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] The token cache is being invalidate because project 851c943ca0d1458c9d6d957a29f18b22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:50.141281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:50.142738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d93e5cdf-ca6c-45ff-9a7b-66c70fc3ed37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:50.144060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0ed77-56f6-442d-8ff3-daaafac8e640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:50.145490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0ed77-56f6-442d-8ff3-daaafac8e640 service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:50.147476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 687/1400] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:49 2022] DELETE /identity/v3/projects/851c943ca0d1458c9d6d957a29f18b22 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:50.157688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ee212-18dc-46e3-ae7f-4b42908023f0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:50.158290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ee212-18dc-46e3-ae7f-4b42908023f0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:50.158655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ee212-18dc-46e3-ae7f-4b42908023f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:50.208730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 714/1401] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 19:57:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 942 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 19:57:50.230759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-266ee212-18dc-46e3-ae7f-4b42908023f0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:50.235100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-266ee212-18dc-46e3-ae7f-4b42908023f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:50.454885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 688/1402] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:50.461157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6238-2226-4c0c-8a10-063011d8f585 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:50.461877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6238-2226-4c0c-8a10-063011d8f585 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:50.462311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b6238-2226-4c0c-8a10-063011d8f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:50.651428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fb9b6238-2226-4c0c-8a10-063011d8f585 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:50.674341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fb9b6238-2226-4c0c-8a10-063011d8f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:50.746206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ee212-18dc-46e3-ae7f-4b42908023f0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:50.755990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 715/1403] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:50.776561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ee212-18dc-46e3-ae7f-4b42908023f0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:50.808134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:50.810084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:50.810793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:50.813460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:50.815666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:50.816607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:50.821288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:50.861529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b6238-2226-4c0c-8a10-063011d8f585 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:50.874020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 689/1404] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:50.901218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b6238-2226-4c0c-8a10-063011d8f585 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:50.917707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:50.919425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:50.921063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:50.922091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:50.924769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:50.931824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:51.036141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:51.064927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 716/1405] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:50 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:51.078253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70dfc9-d0ac-4e48-bb9e-7ca3741e3c83 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:51.445498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:51.446148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:51.446456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:51.446712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:51.447449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:51.449614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:51.557851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 690/1406] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:51 2022] POST /identity/v3/users => generated 293 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:51.562183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:51.592818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1a31f-05b9-4b48-8275-d98f24a68adb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:51.609665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:51.610956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:51.611578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:51.612071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:51.613146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:51.615325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:51.654975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 717/1407] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:51.656237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:51.689417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d41a-7aa2-4dd4-bd40-f0b31d51b4f9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:51.728580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7434f1-2943-4982-a6e1-4241adc04f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:51.729459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7434f1-2943-4982-a6e1-4241adc04f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:51.729765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7434f1-2943-4982-a6e1-4241adc04f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:51.730364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7434f1-2943-4982-a6e1-4241adc04f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:51.741195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7434f1-2943-4982-a6e1-4241adc04f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:51.741925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7434f1-2943-4982-a6e1-4241adc04f0c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:51.816428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 691/1408] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:51.818969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:51.833993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05704693-ecd6-4057-9fe8-18736aaa871e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:51.870762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:51.871383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:51.871983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:51.887729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677f014-1026-42dd-98a1-fd260e1765b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:51.894366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677f014-1026-42dd-98a1-fd260e1765b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:51.900437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677f014-1026-42dd-98a1-fd260e1765b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:51.901084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677f014-1026-42dd-98a1-fd260e1765b3 admin admin] PATH_INFO: `/v3/projects/884b096c44b1454cb5613c507aff1a17/users/4c8379caeaf845b4be25976db36ea286/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:51.973656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] MFA Rules not processed for user `463a0804f17940e4816ab7d984e52a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:51.979587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:51.983462 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677f014-1026-42dd-98a1-fd260e1765b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884b096c44b1454cb5613c507aff1a17, user_id=4c8379caeaf845b4be25976db36ea286, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:52.000777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677f014-1026-42dd-98a1-fd260e1765b3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:52.051966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 718/1409] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:51 2022] PUT /identity/v3/projects/884b096c44b1454cb5613c507aff1a17/users/4c8379caeaf845b4be25976db36ea286/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:57:52.067338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee819b8-1393-489e-835c-f9694169e91f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:52.067695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee819b8-1393-489e-835c-f9694169e91f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:52.068114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee819b8-1393-489e-835c-f9694169e91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:52.214704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-eee819b8-1393-489e-835c-f9694169e91f None None] MFA Rules not processed for user `4c8379caeaf845b4be25976db36ea286`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:52.215987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-eee819b8-1393-489e-835c-f9694169e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:52.270394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:52.308364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:52.319752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 692/1410] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:52.457679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:52.459396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:52.468381 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 719/1411] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:57:52.472794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee819b8-1393-489e-835c-f9694169e91f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:52.497029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1f44d-cf23-4da6-b5cd-e09d1d133701 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:52.675398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:52.676082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:52.676366 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:52.676640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] PATH_INFO: `/v3/projects/2db63d5b366e41b8bfb0951f857289b5` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:52.678371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db63d5b366e41b8bfb0951f857289b5)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:52.681052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:52.773256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee819b8-1393-489e-835c-f9694169e91f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:52.823798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db63d5b366e41b8bfb0951f857289b5', 'request_id': 'req-28214ed5-de0e-4b2e-9abd-24163fc0bd41'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:52.846676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db63d5b366e41b8bfb0951f857289b5', 'request_id': 'req-28214ed5-de0e-4b2e-9abd-24163fc0bd41'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:52.861269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db63d5b366e41b8bfb0951f857289b5', 'request_id': 'req-28214ed5-de0e-4b2e-9abd-24163fc0bd41'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:52.900702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] The token cache is being invalidate because project 2db63d5b366e41b8bfb0951f857289b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:57:52.900810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:52.903878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28214ed5-de0e-4b2e-9abd-24163fc0bd41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:52.909520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 693/1412] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:57:52 2022] DELETE /identity/v3/projects/2db63d5b366e41b8bfb0951f857289b5 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:57:52.911082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:52.912937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:52.913086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f57a1-7f8d-45d6-a59b-5914ebd90422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:52.913839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f57a1-7f8d-45d6-a59b-5914ebd90422 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:52.914388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f57a1-7f8d-45d6-a59b-5914ebd90422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:52.914658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:52.914767 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f57a1-7f8d-45d6-a59b-5914ebd90422 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:52.919285 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f57a1-7f8d-45d6-a59b-5914ebd90422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:52.942917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812f57a1-7f8d-45d6-a59b-5914ebd90422 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.002857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] MFA Rules not processed for user `584b959cf2224df5b526dfb6c45a7fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:53.004385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.066433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 720/1413] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:52 2022] POST /identity/v3/projects => generated 385 bytes in 594 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:53.071729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6a99-a577-4475-8fc9-ed29cc64efb5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.072049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6a99-a577-4475-8fc9-ed29cc64efb5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.073045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac6a99-a577-4475-8fc9-ed29cc64efb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.176672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5aac6a99-a577-4475-8fc9-ed29cc64efb5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:53.177878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5aac6a99-a577-4475-8fc9-ed29cc64efb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.186763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 694/1414] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:53.199755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.202861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.242007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2248d-e09e-416a-b850-dfdbdd71bf38 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.268948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:53.358217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:53.391672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 721/1415] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:53.393148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe3c93-6b22-4d26-8440-466f647b897d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.393459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe3c93-6b22-4d26-8440-466f647b897d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.393823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe3c93-6b22-4d26-8440-466f647b897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.472091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cdbe3c93-6b22-4d26-8440-466f647b897d None None] MFA Rules not processed for user `584b959cf2224df5b526dfb6c45a7fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:53.472091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cdbe3c93-6b22-4d26-8440-466f647b897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.695066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.695984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.701414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.702408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.706163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.708603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.766295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 722/1416] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:53.769878 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24c84-a6ac-4d76-a8a4-14f3dde25bb8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.770198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24c84-a6ac-4d76-a8a4-14f3dde25bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.785574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa24c84-a6ac-4d76-a8a4-14f3dde25bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.815962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 695/1417] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:53 2022] POST /identity/v3/users => generated 299 bytes in 629 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:53.820894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.834097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.850270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0fa24c84-a6ac-4d76-a8a4-14f3dde25bb8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:53.852147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0fa24c84-a6ac-4d76-a8a4-14f3dde25bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:53.882867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 723/1418] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:53.888481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24c84-a6ac-4d76-a8a4-14f3dde25bb8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.916161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa24c84-a6ac-4d76-a8a4-14f3dde25bb8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.929308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.930437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.930952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.931581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.932574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.934741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:53.953161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 724/1419] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:53.954775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:53.969673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c56489-09e3-4aa4-8d88-91ed586476c3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:53.980406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:53.982239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:53.983902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:53.983902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:53.983902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:57:53.984234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:53.986851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.041786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 725/1420] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:57:54.041786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.090168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732d2df-1d8f-4553-a365-0b3f7ac9d7e6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.098805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b08c6-7888-4a79-8b20-b16ad4e0bc35 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.113684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.114986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.115740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.116306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.139737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.141291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.141966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.146940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.149158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.151914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] PATH_INFO: `/v3/projects/c942b093c111485a96b0df53054b62d2/users/e8c989ddd5ae42eb8f30f955d9ab9a18/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.168441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 696/1421] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:54.169549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.181822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101d59a-ce54-452c-b48c-f2e466291dfd service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.188766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.189915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.190270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.190641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.191437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.194218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.245415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 697/1422] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:54.246565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.276306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c942b093c111485a96b0df53054b62d2, user_id=e8c989ddd5ae42eb8f30f955d9ab9a18, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.283921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.324277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 726/1423] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:54 2022] PUT /identity/v3/projects/c942b093c111485a96b0df53054b62d2/users/e8c989ddd5ae42eb8f30f955d9ab9a18/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:54.328432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.452444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2e7e-7af2-402b-a7c3-af3d8ebaf955 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.477396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:54.483812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164b09b-2289-47ed-b78d-41a386adea96 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.489424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.490103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.490380 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.491487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.491487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.494854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.536819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 727/1424] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:54.539222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.563885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.565647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.566531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.567770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.568913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.571462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.583864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fd2f0-3835-4a22-8ca2-14ce7859a6d3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.603906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ef633-6551-4027-ab33-e50fe97f8cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:54.605314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef633-6551-4027-ab33-e50fe97f8cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.605618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef633-6551-4027-ab33-e50fe97f8cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.605895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ef633-6551-4027-ab33-e50fe97f8cc0 admin admin] PATH_INFO: `/v3/projects/c942b093c111485a96b0df53054b62d2/users/e8c989ddd5ae42eb8f30f955d9ab9a18/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.610267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef633-6551-4027-ab33-e50fe97f8cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c942b093c111485a96b0df53054b62d2, user_id=e8c989ddd5ae42eb8f30f955d9ab9a18, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:54.616865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ef633-6551-4027-ab33-e50fe97f8cc0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:54.637932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 698/1425] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/users => generated 292 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:54.642073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:54.654663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 728/1426] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:54 2022] PUT /identity/v3/projects/c942b093c111485a96b0df53054b62d2/users/e8c989ddd5ae42eb8f30f955d9ab9a18/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:54.687649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:54.687933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:54.699815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:54.704425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3026-1e51-4106-a369-34d9e8141be7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:54.858861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] MFA Rules not processed for user `e8c989ddd5ae42eb8f30f955d9ab9a18`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:54.870482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:54.932366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:55.032265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.035054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.036693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.037888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.038808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.049149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.091082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 699/1427] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:54 2022] GET /identity/v3/roles => generated 1420 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:55.093757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.123585 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b1b50-95fe-467e-a88d-693439190fff admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.134558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 729/1428] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:55.136553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.136975 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.137741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.138618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.139906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:55.140307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.141180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.144952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.176372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 700/1429] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:55.178262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.215676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eb6c4-b6c2-422b-859a-2ee2e8029222 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.228434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e64da1-d2ca-4128-9b23-e28e04846762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.229285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64da1-d2ca-4128-9b23-e28e04846762 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.229863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64da1-d2ca-4128-9b23-e28e04846762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.230218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64da1-d2ca-4128-9b23-e28e04846762 admin admin] PATH_INFO: `/v3/projects/cc8283d94019402493d02aded93938a7/users/cef674a5669a47f2bf1b2363f98ffc4e/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.280412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e64da1-d2ca-4128-9b23-e28e04846762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8283d94019402493d02aded93938a7, user_id=cef674a5669a47f2bf1b2363f98ffc4e, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.285791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e64da1-d2ca-4128-9b23-e28e04846762 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.338176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 701/1430] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:55 2022] PUT /identity/v3/projects/cc8283d94019402493d02aded93938a7/users/cef674a5669a47f2bf1b2363f98ffc4e/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:55.355327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e4fd-fe38-4167-8102-cdb0ba0d7927 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.355797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e4fd-fe38-4167-8102-cdb0ba0d7927 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.357303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05e4fd-fe38-4167-8102-cdb0ba0d7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.400779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d94ad-629f-403b-80d6-cd26b470e211 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.455722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7b05e4fd-fe38-4167-8102-cdb0ba0d7927 None None] MFA Rules not processed for user `cef674a5669a47f2bf1b2363f98ffc4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:55.459571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7b05e4fd-fe38-4167-8102-cdb0ba0d7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:55.628651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.631177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.634719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.635493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.644240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:55.683489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 702/1431] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:55.687736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e4fd-fe38-4167-8102-cdb0ba0d7927 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:55.904600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.911616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.919587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05e4fd-fe38-4167-8102-cdb0ba0d7927 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:55.932463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:55.933106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:55.933393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:55.933667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:55.934311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:55.939668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:55.956884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 730/1432] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:56.015646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:56.035369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc055f27-fcb1-44a3-98f8-6cfd8d4c3bc7 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:56.050551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:56.055628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:56.057119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:56.058962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] PATH_INFO: `/v3/users/4c8379caeaf845b4be25976db36ea286` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:56.061104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8379caeaf845b4be25976db36ea286)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:56.065723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 703/1433] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:57:55 2022] POST /identity/v3/projects => generated 385 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:56.066661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:56.068528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:56.144965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:56.250571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8379caeaf845b4be25976db36ea286'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:56.252646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8379caeaf845b4be25976db36ea286'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:56.254670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8379caeaf845b4be25976db36ea286'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:56.291623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8379caeaf845b4be25976db36ea286'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:56.310569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0fd48c-fd53-4490-a1ee-fc27ede1cca3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:56.314509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-36ab5073-abba-4a51-9e47-433b9404702e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8379caeaf845b4be25976db36ea286'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:57:56.356045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:56.358078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:56.358366 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:56.358683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:56.359505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:56.370698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:56.379296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 731/1434] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:57:55 2022] DELETE /identity/v3/users/4c8379caeaf845b4be25976db36ea286 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:56.386488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09747b-ead5-4fd1-9a03-714211f2d167 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:56.386866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09747b-ead5-4fd1-9a03-714211f2d167 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:56.387024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09747b-ead5-4fd1-9a03-714211f2d167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:56.446036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 704/1435] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:57:56 2022] POST /identity/v3/users => generated 299 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:57:56.450658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:56.454107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:56.459298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9f09747b-ead5-4fd1-9a03-714211f2d167 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:56.460817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9f09747b-ead5-4fd1-9a03-714211f2d167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:56.494442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ef43f-d366-4e8a-ac66-28c7cf28936b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:56.677136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:56.677889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:56.678174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:56.678453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:56.679120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:56.680744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:56.689238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 732/1436] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:56.722315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 705/1437] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:56.722434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab87ad-37dd-4261-8566-689091b75ec8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:56.725096 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab87ad-37dd-4261-8566-689091b75ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:56.725421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab87ad-37dd-4261-8566-689091b75ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:56.738223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:56.746914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:56.753367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710e8b-92f4-4a17-b666-c15f46e95783 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:56.769078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-64ab87ad-37dd-4261-8566-689091b75ec8 None None] MFA Rules not processed for user `7157e60fb6fb4b84866ce59f051a9037`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:56.771892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-64ab87ad-37dd-4261-8566-689091b75ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:56.773151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:56.777115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:56.778286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:56.779342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] PATH_INFO: `/v3/projects/41ea81b1871440d081e4ca566120d0a7/users/76304f4ffa5f42169c33fceeefb128be/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:56.836854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ea81b1871440d081e4ca566120d0a7, user_id=76304f4ffa5f42169c33fceeefb128be, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:56.839746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:56.871867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 706/1438] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:56 2022] PUT /identity/v3/projects/41ea81b1871440d081e4ca566120d0a7/users/76304f4ffa5f42169c33fceeefb128be/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:56.872778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:56.883265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:56.967465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 733/1439] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Oct 28 19:57:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:56.967465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab87ad-37dd-4261-8566-689091b75ec8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:57.001102 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab87ad-37dd-4261-8566-689091b75ec8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:57.113136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:57:57.123095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3596d1-a94f-474f-8c75-b5457e5c060a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:57.141706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:57.142350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.142626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.142900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.158465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:57.159474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.159887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.160926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.161859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:57.165591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:57.191004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:57.193807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:57.208660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 734/1440] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:57:57.209889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:57.236498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 707/1441] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:57.243389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606f872-e6f3-4f84-b505-1468fe72df78 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:57.259193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a7dc6-6589-4397-8618-faf7240f67ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:57.260172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a7dc6-6589-4397-8618-faf7240f67ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.260662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a7dc6-6589-4397-8618-faf7240f67ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.260978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a7dc6-6589-4397-8618-faf7240f67ba admin admin] PATH_INFO: `/v3/projects/41ea81b1871440d081e4ca566120d0a7/users/76304f4ffa5f42169c33fceeefb128be/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.263770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a7dc6-6589-4397-8618-faf7240f67ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=41ea81b1871440d081e4ca566120d0a7, user_id=76304f4ffa5f42169c33fceeefb128be, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:57.275892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a7dc6-6589-4397-8618-faf7240f67ba admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:57.298456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 735/1442] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:57:57 2022] PUT /identity/v3/projects/41ea81b1871440d081e4ca566120d0a7/users/76304f4ffa5f42169c33fceeefb128be/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:57:57.300516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:57.311046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.311563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01684389-3a18-4321-b2cb-c4a0724b0aa5 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:57.316769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.317607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.462720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] MFA Rules not processed for user `76304f4ffa5f42169c33fceeefb128be`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:57.464334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:57.465597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b548-ca29-431f-a1e9-1850efe70248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:57.466463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b548-ca29-431f-a1e9-1850efe70248 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.466910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b548-ca29-431f-a1e9-1850efe70248 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.467339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b548-ca29-431f-a1e9-1850efe70248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.478685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b548-ca29-431f-a1e9-1850efe70248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:57.482597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b548-ca29-431f-a1e9-1850efe70248 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:57.509988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 708/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:57:57.697620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:57.698404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:57.698777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:57.741350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] MFA Rules not processed for user `e2da9a7ca37b4010a65e088515adcc57`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:57:57.742832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:57.791234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 736/1444] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:57.805751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:57:57.808785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:57.939432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 709/1445] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:57:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:57:58.159847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e2610-bb7f-4492-b9f5-ba72fdb3acb5 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:57:58.207045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:57:58.207717 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:57:58.207990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:57:58.208261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:57:58.226741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:57:58.525756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:57:58.544925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:57:58.604978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 737/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:57:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 800 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:00.642096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:00.644469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:00.722690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:00.792961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2658d9a-86aa-4332-b1e9-d71b3f563849 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:00.798922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:00.800178 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:00.800510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:00.800824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] PATH_INFO: `/v3/projects/884b096c44b1454cb5613c507aff1a17` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:00.802756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=884b096c44b1454cb5613c507aff1a17)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:00.805536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:00.907004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884b096c44b1454cb5613c507aff1a17', 'request_id': 'req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:00.913986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884b096c44b1454cb5613c507aff1a17', 'request_id': 'req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:00.929504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884b096c44b1454cb5613c507aff1a17', 'request_id': 'req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:00.966908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] The token cache is being invalidate because project 884b096c44b1454cb5613c507aff1a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:00.966908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:00.968081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-20df4304-7a5a-47ac-84b1-a6df1ca0c5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:00.969962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 710/1447] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:00 2022] DELETE /identity/v3/projects/884b096c44b1454cb5613c507aff1a17 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:00.974292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:00.981887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:01.014067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d870968-d15d-401c-8644-2f039ba1cf62 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:01.326368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:01.327066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:01.327349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:01.327622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] PATH_INFO: `/v3/users/e8c989ddd5ae42eb8f30f955d9ab9a18` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:01.334406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c989ddd5ae42eb8f30f955d9ab9a18)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:01.336612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:01.493543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c989ddd5ae42eb8f30f955d9ab9a18'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.494604 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c989ddd5ae42eb8f30f955d9ab9a18'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.495219 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c989ddd5ae42eb8f30f955d9ab9a18'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.522278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c989ddd5ae42eb8f30f955d9ab9a18'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.555591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-82c8d59d-f088-4d7d-b6d4-1b9181792390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c989ddd5ae42eb8f30f955d9ab9a18'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:01.594918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 738/1448] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:00 2022] DELETE /identity/v3/users/e8c989ddd5ae42eb8f30f955d9ab9a18 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:02.024553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ef6f-0be8-4526-991e-21817fa154f2 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.025166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ef6f-0be8-4526-991e-21817fa154f2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.025166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14ef6f-0be8-4526-991e-21817fa154f2 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.026885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 711/1449] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 19:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:58:02.339006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d9a1-c696-4f56-ae76-a61e6805b064 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.339633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d9a1-c696-4f56-ae76-a61e6805b064 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.339633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58d9a1-c696-4f56-ae76-a61e6805b064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.428666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fe58d9a1-c696-4f56-ae76-a61e6805b064 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:02.437308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fe58d9a1-c696-4f56-ae76-a61e6805b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.695013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 739/1450] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 19:58:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:02.881928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ef6f-0be8-4526-991e-21817fa154f2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:02.884776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-be14ef6f-0be8-4526-991e-21817fa154f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:02.932882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14ef6f-0be8-4526-991e-21817fa154f2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:02.950167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:02.951261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:02.952251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:02.960113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:02.979979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:02.982740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:03.002575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 712/1451] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:04.535639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:04.536341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:04.536341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:04.644402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] MFA Rules not processed for user `d4967aae8aa544d0b3da824976e0d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:04.645894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:04.696996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:04.909508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 740/1452] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:05.307029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:05.309293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:05.500599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dd99a-93e4-400a-b3e6-9614dea53453 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:05.518976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:05.519640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:05.519914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:05.520196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] PATH_INFO: `/v3/projects/c942b093c111485a96b0df53054b62d2` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:05.524038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c942b093c111485a96b0df53054b62d2)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:05.527418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:05.710665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c942b093c111485a96b0df53054b62d2', 'request_id': 'req-0dac3f81-586e-465d-ad03-549e8493948c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:05.712594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:05.721532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c942b093c111485a96b0df53054b62d2', 'request_id': 'req-0dac3f81-586e-465d-ad03-549e8493948c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:05.729270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c942b093c111485a96b0df53054b62d2', 'request_id': 'req-0dac3f81-586e-465d-ad03-549e8493948c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:05.745744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:05.747614 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:05.753182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] The token cache is being invalidate because project c942b093c111485a96b0df53054b62d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:05.753694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:05.754820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dac3f81-586e-465d-ad03-549e8493948c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:05.765236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 713/1453] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:05 2022] DELETE /identity/v3/projects/c942b093c111485a96b0df53054b62d2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:05.769288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117cf4-2ced-45de-8953-7cd4b1ddaacb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:05.769730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117cf4-2ced-45de-8953-7cd4b1ddaacb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:05.770120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea117cf4-2ced-45de-8953-7cd4b1ddaacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:05.800738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ea117cf4-2ced-45de-8953-7cd4b1ddaacb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:05.801773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ea117cf4-2ced-45de-8953-7cd4b1ddaacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:05.925928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980453db-8618-4fc3-be06-dd03df0950a1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.016560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 714/1454] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:06.035064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7958-fa48-4866-8c0b-8865cdae8d31 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.035513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7958-fa48-4866-8c0b-8865cdae8d31 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.035929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a7958-fa48-4866-8c0b-8865cdae8d31 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.042054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 715/1455] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 19:58:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:58:06.047901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dddbec-3d5e-455f-8095-1e73927edbf6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.049276 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dddbec-3d5e-455f-8095-1e73927edbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.050869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dddbec-3d5e-455f-8095-1e73927edbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.078772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.080072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.080655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.081135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.089985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:06.106487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-37dddbec-3d5e-455f-8095-1e73927edbf6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:06.111060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-37dddbec-3d5e-455f-8095-1e73927edbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:06.132805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 716/1456] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:06.142350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1474f60-ac15-4f82-b447-bffae2d0c854 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.143082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1474f60-ac15-4f82-b447-bffae2d0c854 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.144069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1474f60-ac15-4f82-b447-bffae2d0c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.233945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:06.236641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:06.239586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c1474f60-ac15-4f82-b447-bffae2d0c854 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:06.241720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c1474f60-ac15-4f82-b447-bffae2d0c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:06.262080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 741/1457] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:06.263101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:06.286612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c529-55a0-41b7-a47e-957a236447d1 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.302178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.302935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.303277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.303551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.304284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:06.304651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:06.306659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:06.341719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 742/1458] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:06.346490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:06.368896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c867d4-cf81-44bf-8f67-91332d892337 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.386044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.386747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.387053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.387360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.388186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:06.394764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:06.426366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:06.471210 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 717/1459] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 19:58:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:06.478051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 743/1460] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:06 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:06.481303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1474f60-ac15-4f82-b447-bffae2d0c854 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:06.511262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1474f60-ac15-4f82-b447-bffae2d0c854 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.732095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.733025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.733484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.733897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.735419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:06.740404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:06.763129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:06.794149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 718/1461] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:06 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:06.805991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:06.823149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed33b7-411d-4547-8eed-58a32eb88533 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.844282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.845564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.845564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.845962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.847633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:06.850889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:06.879663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 744/1462] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:06.882268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:06.896374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c452e-8426-4b72-a5a6-14009e6b46c8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.911422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498d904-e9ce-4d05-adc2-7134d985eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.912130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d904-e9ce-4d05-adc2-7134d985eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.912405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d904-e9ce-4d05-adc2-7134d985eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.912687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498d904-e9ce-4d05-adc2-7134d985eb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:06.913473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498d904-e9ce-4d05-adc2-7134d985eb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:06.915153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498d904-e9ce-4d05-adc2-7134d985eb6a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:06.940700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 719/1463] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:06.942520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:06.960914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605da09-8fef-4ce2-9e18-be100728a232 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:06.980784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:06.981788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:06.982301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:06.982866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] PATH_INFO: `/v3/projects/e9ed7d9ccb1d424b8ce46f51cdc39fc9/users/31c0a0f5771b4334a36bdcceb0f266d1/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:07.051254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ed7d9ccb1d424b8ce46f51cdc39fc9, user_id=31c0a0f5771b4334a36bdcceb0f266d1, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:07.067355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:07.103579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 745/1464] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:06 2022] PUT /identity/v3/projects/e9ed7d9ccb1d424b8ce46f51cdc39fc9/users/31c0a0f5771b4334a36bdcceb0f266d1/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:07.113585 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674818-d7c7-4a24-a814-ce36b9006631 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:07.114205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674818-d7c7-4a24-a814-ce36b9006631 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:07.114205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be674818-d7c7-4a24-a814-ce36b9006631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:07.190434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-be674818-d7c7-4a24-a814-ce36b9006631 None None] MFA Rules not processed for user `31c0a0f5771b4334a36bdcceb0f266d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:07.200390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-be674818-d7c7-4a24-a814-ce36b9006631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:07.337317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:07.339432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:07.425552 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 720/1465] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:07.426794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674818-d7c7-4a24-a814-ce36b9006631 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:07.485750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812cc93-1ee9-46ff-bb89-61bddc3974bd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:07.502847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:07.504113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:07.504768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:07.505175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:07.523945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:07.525943 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:07.537868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be674818-d7c7-4a24-a814-ce36b9006631 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:07.543292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:07.544176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:07.544761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 746/1466] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:07.545628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:07.545999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:07.546767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:07.549152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:07.601722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:07.613290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 721/1467] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:07 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:07.620116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d74c1-7e68-434d-b254-e6b91a8198d2 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:07.731699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:07.733542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:07.734167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:07.734886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:07.736095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:07.738464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:07.785995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 747/1468] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:07 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:07.786690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:07.811640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf0c87-6e34-4807-86f7-f986229d3c4c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:07.825205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:07.825957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:07.826338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:07.826701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:07.827442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:07.829541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:07.853950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 722/1469] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:07.854698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:07.867798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1cefc-fa49-4008-b67c-7a83fbe6cec2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:07.876772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:07.877581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:07.877866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:07.878153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] PATH_INFO: `/v3/projects/257e3e9b67e44183a4fe9ba8b8ca511e/users/55c7a633b46f4ab7ad6030b2431cb45a/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:07.902125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=257e3e9b67e44183a4fe9ba8b8ca511e, user_id=55c7a633b46f4ab7ad6030b2431cb45a, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:07.905605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:07.958596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 748/1470] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:07 2022] PUT /identity/v3/projects/257e3e9b67e44183a4fe9ba8b8ca511e/users/55c7a633b46f4ab7ad6030b2431cb45a/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:07.963460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:07.976327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abb957-1e5b-4fa0-a5a0-6eed6aa8f4b6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:08.057824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:08.098875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e09550e-44e8-4593-8b69-4b8474bd0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:08.099508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09550e-44e8-4593-8b69-4b8474bd0a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:08.099892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09550e-44e8-4593-8b69-4b8474bd0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:08.100042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09550e-44e8-4593-8b69-4b8474bd0a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:08.100693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09550e-44e8-4593-8b69-4b8474bd0a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:08.102344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e09550e-44e8-4593-8b69-4b8474bd0a50 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:08.126880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 723/1471] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:08.128509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:08.143563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:08.151637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065fa4-3a05-4f48-bbed-9731c294f81e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:08.167075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:08.167765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:08.170029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:08.173833 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] PATH_INFO: `/v3/projects/257e3e9b67e44183a4fe9ba8b8ca511e/users/55c7a633b46f4ab7ad6030b2431cb45a/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:08.176175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=257e3e9b67e44183a4fe9ba8b8ca511e, user_id=55c7a633b46f4ab7ad6030b2431cb45a, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:08.182382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:08.233057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 749/1472] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:08 2022] PUT /identity/v3/projects/257e3e9b67e44183a4fe9ba8b8ca511e/users/55c7a633b46f4ab7ad6030b2431cb45a/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:08.243800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f6ed-6bc3-4c2f-94d4-d0248f07fe67 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:08.244089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f6ed-6bc3-4c2f-94d4-d0248f07fe67 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:08.245039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811f6ed-6bc3-4c2f-94d4-d0248f07fe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:08.298942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6811f6ed-6bc3-4c2f-94d4-d0248f07fe67 None None] MFA Rules not processed for user `55c7a633b46f4ab7ad6030b2431cb45a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:08.300321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6811f6ed-6bc3-4c2f-94d4-d0248f07fe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:08.504937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 724/1473] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:08.559849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:08.562366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:08.769419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d2460-b4d4-48a4-afcd-10ceaa99c06a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:08.786284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a1d81-78d5-426d-a617-0e101873f794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:08.789113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a1d81-78d5-426d-a617-0e101873f794 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:08.790703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a1d81-78d5-426d-a617-0e101873f794 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:08.792583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a1d81-78d5-426d-a617-0e101873f794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:08.824278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a1d81-78d5-426d-a617-0e101873f794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:08.831826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a1d81-78d5-426d-a617-0e101873f794 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:08.866176 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 750/1474] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:08.974450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f6ed-6bc3-4c2f-94d4-d0248f07fe67 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:09.184578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811f6ed-6bc3-4c2f-94d4-d0248f07fe67 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:09.197650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:09.198040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:09.198260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:09.201129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] PATH_INFO: `/v3/users/31c0a0f5771b4334a36bdcceb0f266d1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:09.202678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c0a0f5771b4334a36bdcceb0f266d1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:09.207741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:09.335944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c0a0f5771b4334a36bdcceb0f266d1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:09.365750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c0a0f5771b4334a36bdcceb0f266d1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:09.366479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c0a0f5771b4334a36bdcceb0f266d1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:09.376280 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:09.387775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c0a0f5771b4334a36bdcceb0f266d1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:09.388713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c0a0f5771b4334a36bdcceb0f266d1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:09.415362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 725/1475] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:08 2022] DELETE /identity/v3/users/31c0a0f5771b4334a36bdcceb0f266d1 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:09.417340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:09.417736 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:09.418253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:09.443063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:09.444417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:09.528406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 751/1476] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:09.541668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:09.543763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:09.687537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bd161-2bb2-46cc-a515-bd20a0ef3af1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:09.693132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:09.694200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:09.694473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:09.694908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:09.705900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:09.707497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:09.729448 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 726/1477] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:10.821979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:10.823620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:10.848618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46222afc-80b0-4c67-8152-1fbd0ca4687b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:10.854520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:10.855440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:10.856094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:10.856570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] PATH_INFO: `/v3/projects/e9ed7d9ccb1d424b8ce46f51cdc39fc9` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:10.858147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ed7d9ccb1d424b8ce46f51cdc39fc9)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:10.860449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:10.914782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ed7d9ccb1d424b8ce46f51cdc39fc9', 'request_id': 'req-f6e56ec6-e340-4291-8f79-4287e4cf943f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:10.922384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ed7d9ccb1d424b8ce46f51cdc39fc9', 'request_id': 'req-f6e56ec6-e340-4291-8f79-4287e4cf943f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:10.931411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ed7d9ccb1d424b8ce46f51cdc39fc9', 'request_id': 'req-f6e56ec6-e340-4291-8f79-4287e4cf943f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:10.955590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] The token cache is being invalidate because project e9ed7d9ccb1d424b8ce46f51cdc39fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:10.956269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:10.958031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:10.961479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 752/1478] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:10 2022] DELETE /identity/v3/projects/e9ed7d9ccb1d424b8ce46f51cdc39fc9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:10.965511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:10.979789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312031-881f-488f-9cbf-4d046091ff7c service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:11.081147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:11.082137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:11.082732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:11.083357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] PATH_INFO: `/v3/users/55c7a633b46f4ab7ad6030b2431cb45a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:11.085351 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55c7a633b46f4ab7ad6030b2431cb45a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:11.088212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:11.231054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55c7a633b46f4ab7ad6030b2431cb45a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:11.275993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55c7a633b46f4ab7ad6030b2431cb45a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:11.279440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55c7a633b46f4ab7ad6030b2431cb45a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:11.297071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55c7a633b46f4ab7ad6030b2431cb45a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:11.299683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6e94a6c2-b636-4c55-b67b-35ca697cc961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55c7a633b46f4ab7ad6030b2431cb45a'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:11.325858 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 727/1479] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:10 2022] DELETE /identity/v3/users/55c7a633b46f4ab7ad6030b2431cb45a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:12.076960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:12.079318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:12.102223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e56ec6-e340-4291-8f79-4287e4cf943f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:12.154026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:12.258815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:12.260474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:12.261233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:12.261723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] PATH_INFO: `/v3/projects/257e3e9b67e44183a4fe9ba8b8ca511e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:12.264652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=257e3e9b67e44183a4fe9ba8b8ca511e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:12.281731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:12.407857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257e3e9b67e44183a4fe9ba8b8ca511e', 'request_id': 'req-bb8fbc3e-fbed-423d-ba72-fccc3583c889'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:12.423033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257e3e9b67e44183a4fe9ba8b8ca511e', 'request_id': 'req-bb8fbc3e-fbed-423d-ba72-fccc3583c889'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:12.433984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257e3e9b67e44183a4fe9ba8b8ca511e', 'request_id': 'req-bb8fbc3e-fbed-423d-ba72-fccc3583c889'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:12.460852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] The token cache is being invalidate because project 257e3e9b67e44183a4fe9ba8b8ca511e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:12.461770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:12.462619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb8fbc3e-fbed-423d-ba72-fccc3583c889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:12.466489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 753/1480] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:12 2022] DELETE /identity/v3/projects/257e3e9b67e44183a4fe9ba8b8ca511e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:12.472269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581a260-a3cd-4a10-a095-02c1b77ee5c6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:12.472805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581a260-a3cd-4a10-a095-02c1b77ee5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:12.473077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581a260-a3cd-4a10-a095-02c1b77ee5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:12.507939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c581a260-a3cd-4a10-a095-02c1b77ee5c6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:12.510687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c581a260-a3cd-4a10-a095-02c1b77ee5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:12.519440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:12.593238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f2ba-7479-4b96-b909-884825ba0acd None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:12.593238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f2ba-7479-4b96-b909-884825ba0acd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:12.593495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f2ba-7479-4b96-b909-884825ba0acd None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:12.594976 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 754/1481] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 19:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:58:12.623503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a235-752e-4bc1-b277-1acc2e6e1875 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:12.623791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a235-752e-4bc1-b277-1acc2e6e1875 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:12.624604 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4a235-752e-4bc1-b277-1acc2e6e1875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:12.645713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 728/1482] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:12.658251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:12.659285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:12.659810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:12.670569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cbb4a235-752e-4bc1-b277-1acc2e6e1875 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:12.671827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cbb4a235-752e-4bc1-b277-1acc2e6e1875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:12.723080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:12.724538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:12.759695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 729/1483] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:12.767812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:12.774134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:12.801776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa7b62-1606-41a5-9a27-a74388e35b5f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:12.813467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:12.817765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:12.818007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:12.818286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] PATH_INFO: `/v3/users/cef674a5669a47f2bf1b2363f98ffc4e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:12.820097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef674a5669a47f2bf1b2363f98ffc4e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:12.822131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:12.875430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 755/1484] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 19:58:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:12.876322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a235-752e-4bc1-b277-1acc2e6e1875 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:12.905607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4a235-752e-4bc1-b277-1acc2e6e1875 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:12.917189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:12.919090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:12.919418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:12.919719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:12.924282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:12.929772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:12.931570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:12.951355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef674a5669a47f2bf1b2363f98ffc4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:12.975368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 756/1485] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:12.976413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:12.989695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef674a5669a47f2bf1b2363f98ffc4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:12.990627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef674a5669a47f2bf1b2363f98ffc4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:13.005581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f458e-12f7-4ac2-8062-47b5c8030039 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:13.011493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef674a5669a47f2bf1b2363f98ffc4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:13.012688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3c75e320-766b-4e8e-abe4-c8236a7641a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef674a5669a47f2bf1b2363f98ffc4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:13.018304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:13.018948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.019251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.019549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.020296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:13.023673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:13.042175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 730/1486] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:12 2022] DELETE /identity/v3/users/cef674a5669a47f2bf1b2363f98ffc4e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:13.047472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.047764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.048031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.103207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:13.104447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:13.104909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 757/1487] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:12 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:13.109262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:13.112020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:13.130367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:13.269654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 731/1488] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:13.270731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:13.272181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:13.294627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77508c5-f5ea-458d-9b2d-e3bacb763a46 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:13.299632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:13.306508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:13.307741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.308349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.308812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.309699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:13.344191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:13.428376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 758/1489] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:13 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:13.429306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:13.441094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:13.457558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266a4b-9e7a-428a-bdfc-0ef9f9e8f819 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:13.473511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:13.474134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.474420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.474694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.479649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:13.516267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:13.519821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:13.536009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 732/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:13.536877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:13.549977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e189fc-66b6-44e1-b843-d8851b296cf6 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:13.555124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:13.555874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.556148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.556413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.557048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:13.559500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:13.578139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 733/1491] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:13.583829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c34de24-e425-4fd0-b699-717c7eb17d82 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:13.584008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:13.588846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:13.589677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.590190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.590948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.600576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01c0b8-1105-4645-ab06-5d0f12574d3f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:13.608066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:13.609173 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da129-dab4-487a-ad27-d543c76904d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:13.609898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:13.610136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da129-dab4-487a-ad27-d543c76904d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.610453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da129-dab4-487a-ad27-d543c76904d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.610893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da129-dab4-487a-ad27-d543c76904d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.611544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da129-dab4-487a-ad27-d543c76904d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:13.613444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da129-dab4-487a-ad27-d543c76904d0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:13.622240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 759/1492] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:13.630414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 734/1493] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:13.636209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:13.659686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6800e-5200-4738-8167-bd27583dc8ad service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:13.681583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:13.682402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.682809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.682998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] PATH_INFO: `/v3/projects/794711e68f8547f8aa02f950ce795f32/users/ed6b88abbcb2453196bd9256039edac2/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.707840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794711e68f8547f8aa02f950ce795f32, user_id=ed6b88abbcb2453196bd9256039edac2, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:13.711220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:13.736426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 760/1494] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:13 2022] PUT /identity/v3/projects/794711e68f8547f8aa02f950ce795f32/users/ed6b88abbcb2453196bd9256039edac2/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:13.744186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc438c0-9963-4966-8dd1-ed4415b6e74c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:13.744472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc438c0-9963-4966-8dd1-ed4415b6e74c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:13.747088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc438c0-9963-4966-8dd1-ed4415b6e74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:13.787090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8cc438c0-9963-4966-8dd1-ed4415b6e74c None None] MFA Rules not processed for user `ed6b88abbcb2453196bd9256039edac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:13.789313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8cc438c0-9963-4966-8dd1-ed4415b6e74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:13.896302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 735/1495] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:13.907865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:14.022510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b17b2-0978-4f82-bea8-7d0fe5d1a6b0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:14.029040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:14.030203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.030203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.030426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.031040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:14.033204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:14.061449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:14.079853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc438c0-9963-4966-8dd1-ed4415b6e74c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:14.082693 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 761/1496] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:13 2022] POST /identity/v3/projects => generated 387 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:14.091243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc438c0-9963-4966-8dd1-ed4415b6e74c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:14.169489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:14.170174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.170449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.170710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.171346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:14.173328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:14.203219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:14.209095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 736/1497] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:14 2022] POST /identity/v3/users => generated 300 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:14.210469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:14.222559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98233ea-ec19-4ecd-b1e9-b8338627b4ed admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:14.227749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:14.228440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.228897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.229609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.229937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:14.232007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:14.249965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 762/1498] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:14.251151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:14.265273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4d04c-b22b-45e5-b2f1-eca64215a58c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:14.272664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:14.273634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.274066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.274438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] PATH_INFO: `/v3/projects/c7c06e800bf6447386cc8f485616f689/users/77d8b47dd17244758c950d0ac5c07976/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.300367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c06e800bf6447386cc8f485616f689, user_id=77d8b47dd17244758c950d0ac5c07976, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:14.305417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:14.325341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 737/1499] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:14 2022] PUT /identity/v3/projects/c7c06e800bf6447386cc8f485616f689/users/77d8b47dd17244758c950d0ac5c07976/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:14.329600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:14.345323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5ecde-9d66-4674-a596-48177e7067d9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:14.428708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e50b0-65a5-48f8-ab00-0b56f701d5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:14.429744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e50b0-65a5-48f8-ab00-0b56f701d5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.430222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e50b0-65a5-48f8-ab00-0b56f701d5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.430782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e50b0-65a5-48f8-ab00-0b56f701d5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.431944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e50b0-65a5-48f8-ab00-0b56f701d5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:14.434388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e50b0-65a5-48f8-ab00-0b56f701d5f9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:14.448356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 763/1500] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:14.452578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:14.474586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eab0a-fe91-42c4-aeaa-f7e9a1a50741 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:14.486166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:14.486861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.487145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.487444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] PATH_INFO: `/v3/projects/c7c06e800bf6447386cc8f485616f689/users/77d8b47dd17244758c950d0ac5c07976/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.500153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c06e800bf6447386cc8f485616f689, user_id=77d8b47dd17244758c950d0ac5c07976, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:14.506447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:14.549665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 738/1501] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:14 2022] PUT /identity/v3/projects/c7c06e800bf6447386cc8f485616f689/users/77d8b47dd17244758c950d0ac5c07976/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:14.563464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.563749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.564032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.625960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] MFA Rules not processed for user `77d8b47dd17244758c950d0ac5c07976`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:14.627413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:14.743529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 764/1502] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:14.755156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:14.757832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:14.885646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85cd8c-6bc7-486c-b5c8-03698e3e2e13 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:14.890028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:14.891163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:14.892198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:14.892719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:14.903968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:14.905881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:14.920080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 739/1503] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:15.200198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:15.201662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:15.290505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce9139-da3f-4ce7-ae1b-b706df57c06f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:15.296284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:15.297247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:15.297598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:15.297901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] PATH_INFO: `/v3/projects/cc8283d94019402493d02aded93938a7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:15.300666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8283d94019402493d02aded93938a7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:15.304133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:15.323115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:15.377238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8283d94019402493d02aded93938a7', 'request_id': 'req-da13ef2a-d7d4-40b4-9626-bacf46954ffe'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.384971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8283d94019402493d02aded93938a7', 'request_id': 'req-da13ef2a-d7d4-40b4-9626-bacf46954ffe'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.393086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8283d94019402493d02aded93938a7', 'request_id': 'req-da13ef2a-d7d4-40b4-9626-bacf46954ffe'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.409952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] The token cache is being invalidate because project cc8283d94019402493d02aded93938a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:15.410200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.410990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.412926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 765/1504] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:15 2022] DELETE /identity/v3/projects/cc8283d94019402493d02aded93938a7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:15.417730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:15.442768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c55763f-9b2b-4c10-8b4f-ba5e1a09cd06 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:15.518789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:15.519426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:15.519736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:15.520014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] PATH_INFO: `/v3/users/76304f4ffa5f42169c33fceeefb128be` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:15.521559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=76304f4ffa5f42169c33fceeefb128be)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:15.526600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:15.612620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76304f4ffa5f42169c33fceeefb128be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.655115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76304f4ffa5f42169c33fceeefb128be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.657023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76304f4ffa5f42169c33fceeefb128be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.659368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:15.683584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76304f4ffa5f42169c33fceeefb128be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.688800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-580d96f8-6df5-4e13-a5a3-9366a33f80ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76304f4ffa5f42169c33fceeefb128be'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.708063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 740/1505] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:15 2022] DELETE /identity/v3/users/76304f4ffa5f42169c33fceeefb128be => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:15.771401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:15.773821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:15.789446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13ef2a-d7d4-40b4-9626-bacf46954ffe admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:15.866154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:15.867414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:15.867919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:15.868288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] PATH_INFO: `/v3/users/ed6b88abbcb2453196bd9256039edac2` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:15.869646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed6b88abbcb2453196bd9256039edac2)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:15.871823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:15.932380 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed6b88abbcb2453196bd9256039edac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.933240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed6b88abbcb2453196bd9256039edac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.934167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed6b88abbcb2453196bd9256039edac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.953292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed6b88abbcb2453196bd9256039edac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.960739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed6b88abbcb2453196bd9256039edac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:15.975997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 766/1506] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:15 2022] DELETE /identity/v3/users/ed6b88abbcb2453196bd9256039edac2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:15.980921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:15.981319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:15.981682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.003944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:16.005218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:16.091874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 741/1507] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:16.110629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:16.113060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:16.171492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:16.178318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:16.181836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:16.258535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db819d9f-95f2-482d-ae24-2b77b3b1d44b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:16.279100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:16.283132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:16.284180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:16.285948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] PATH_INFO: `/v3/projects/41ea81b1871440d081e4ca566120d0a7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.288567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41ea81b1871440d081e4ca566120d0a7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:16.294893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:16.326885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0191636e-2911-43d8-ae0b-505ff0aa896e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:16.339339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e5d5c-50ef-41b6-a104-c27d5f394779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:16.340202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e5d5c-50ef-41b6-a104-c27d5f394779 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:16.340651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e5d5c-50ef-41b6-a104-c27d5f394779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:16.341060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e5d5c-50ef-41b6-a104-c27d5f394779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.362025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e5d5c-50ef-41b6-a104-c27d5f394779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:16.363964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e5d5c-50ef-41b6-a104-c27d5f394779 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:16.380847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 767/1508] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:16.416409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41ea81b1871440d081e4ca566120d0a7', 'request_id': 'req-6b61f4d3-04c5-4651-862d-ed47d1432e3f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:16.434954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41ea81b1871440d081e4ca566120d0a7', 'request_id': 'req-6b61f4d3-04c5-4651-862d-ed47d1432e3f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:16.462473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41ea81b1871440d081e4ca566120d0a7', 'request_id': 'req-6b61f4d3-04c5-4651-862d-ed47d1432e3f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:16.486158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] The token cache is being invalidate because project 41ea81b1871440d081e4ca566120d0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:16.486447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:16.491406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6b61f4d3-04c5-4651-862d-ed47d1432e3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:16.494420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 742/1509] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:16 2022] DELETE /identity/v3/projects/41ea81b1871440d081e4ca566120d0a7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:16.502369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191cc7-962c-4bf7-8ccf-57c870062fd9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:16.502784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191cc7-962c-4bf7-8ccf-57c870062fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:16.502953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191cc7-962c-4bf7-8ccf-57c870062fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.577038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-bd191cc7-962c-4bf7-8ccf-57c870062fd9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:16.580024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bd191cc7-962c-4bf7-8ccf-57c870062fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:16.822410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 768/1510] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:16.843340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64abe5-8fcc-45b0-b939-a3decd946cd7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:16.844191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64abe5-8fcc-45b0-b939-a3decd946cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:16.844590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64abe5-8fcc-45b0-b939-a3decd946cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.882882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0d64abe5-8fcc-45b0-b939-a3decd946cd7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:16.886442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0d64abe5-8fcc-45b0-b939-a3decd946cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:16.917202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 743/1511] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:16.922334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191cc7-962c-4bf7-8ccf-57c870062fd9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:16.935071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191cc7-962c-4bf7-8ccf-57c870062fd9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:16.942605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:16.943396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:16.943738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:16.944549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.944888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:16.945243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:16.947346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:16.975522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 769/1512] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:16.976101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64abe5-8fcc-45b0-b939-a3decd946cd7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:16.986384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64abe5-8fcc-45b0-b939-a3decd946cd7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:16.992114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:16.993025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:16.993512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:16.993960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:16.994920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:16.997235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.058948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.071454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 744/1513] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:16 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:17.077761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8087df-f961-4898-b5fe-20fe125cf8f0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.106731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.111377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:17.212646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.213315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.213619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.213887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.214523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.216490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.229063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:17.243414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 770/1514] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:17 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:17.249404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.267739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c7fd5-d1f3-49da-a478-25b28a631d6e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.272858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.273892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.274694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.275103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.275895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.277694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.289966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 771/1515] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:17.294031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.301278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25fdc8-13f6-4ee6-b2f2-61e3b52e648e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.306808 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a39cc-1a40-4132-b099-e7ba8af4a5ff admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.312562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.313188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.313495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.313768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.315291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.316018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.316715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.316990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.317140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.317544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] PATH_INFO: `/v3/projects/794711e68f8547f8aa02f950ce795f32` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.320035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=794711e68f8547f8aa02f950ce795f32)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.322010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.329807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 772/1516] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:17.336320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.349220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c8b02-05a3-49f9-9ca8-9e9bdae61aa4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.355962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3b9d1-5875-45b7-8576-7c3eed5485d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.356904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b9d1-5875-45b7-8576-7c3eed5485d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.357900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b9d1-5875-45b7-8576-7c3eed5485d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.358321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3b9d1-5875-45b7-8576-7c3eed5485d5 admin admin] PATH_INFO: `/v3/projects/a33d62f060f840198dcd73d8c7323ed6/users/edc5932d2fac4d4baa6c54e718a42462/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.378500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:17.385485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b9d1-5875-45b7-8576-7c3eed5485d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a33d62f060f840198dcd73d8c7323ed6, user_id=edc5932d2fac4d4baa6c54e718a42462, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.388948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3b9d1-5875-45b7-8576-7c3eed5485d5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.408160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794711e68f8547f8aa02f950ce795f32', 'request_id': 'req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.426046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 773/1517] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:17 2022] PUT /identity/v3/projects/a33d62f060f840198dcd73d8c7323ed6/users/edc5932d2fac4d4baa6c54e718a42462/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:17.426430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794711e68f8547f8aa02f950ce795f32', 'request_id': 'req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.426430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794711e68f8547f8aa02f950ce795f32', 'request_id': 'req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.432292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.432883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.433435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.440473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] The token cache is being invalidate because project 794711e68f8547f8aa02f950ce795f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:17.440884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.441696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.444159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 745/1518] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:17 2022] DELETE /identity/v3/projects/794711e68f8547f8aa02f950ce795f32 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:17.448437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.450085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:17.473108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] MFA Rules not processed for user `edc5932d2fac4d4baa6c54e718a42462`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:17.476464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:17.546831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccb9ab-bb37-4747-9a4a-611a058f0b98 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.587814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 774/1519] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:17.607905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.609782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:17.635568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.636520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.637715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.638133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] PATH_INFO: `/v3/users/77d8b47dd17244758c950d0ac5c07976` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.641348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d8b47dd17244758c950d0ac5c07976)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.645168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.672792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:17.698035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff9de0-b328-49cc-bec3-0e16b122bd8c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.703989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.704694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.705175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.705567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.716678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d8b47dd17244758c950d0ac5c07976'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.725988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.727476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.737824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d8b47dd17244758c950d0ac5c07976'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.739546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d8b47dd17244758c950d0ac5c07976'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.740520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 775/1520] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:17.752226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d8b47dd17244758c950d0ac5c07976'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.752986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ab1edf4b-6bfe-4fff-a831-f3eb34a408b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d8b47dd17244758c950d0ac5c07976'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.774863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:17.776212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 746/1521] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:17 2022] DELETE /identity/v3/users/77d8b47dd17244758c950d0ac5c07976 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:17.776630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:17.791472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45370d6-14d7-4475-a5fd-34caffa518c6 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:17.866206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:17.866858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.867266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.867541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] PATH_INFO: `/v3/users/edc5932d2fac4d4baa6c54e718a42462` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:17.868813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edc5932d2fac4d4baa6c54e718a42462)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:17.870690 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:17.902426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:17.931653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edc5932d2fac4d4baa6c54e718a42462'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.932720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edc5932d2fac4d4baa6c54e718a42462'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.933463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edc5932d2fac4d4baa6c54e718a42462'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.959689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edc5932d2fac4d4baa6c54e718a42462'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.968353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edc5932d2fac4d4baa6c54e718a42462'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:17.983182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 776/1522] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:17 2022] DELETE /identity/v3/users/edc5932d2fac4d4baa6c54e718a42462 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:17.987809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:17.988301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:17.988476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.008444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:18.009688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.069958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 747/1523] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:18.080284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:18.081829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.149942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41e91a-ce81-4ca9-9ca7-19d45bef4d64 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:18.154165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290cca-e93c-410c-8616-3c94438d90d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:18.155008 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290cca-e93c-410c-8616-3c94438d90d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.155360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290cca-e93c-410c-8616-3c94438d90d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.155944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290cca-e93c-410c-8616-3c94438d90d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.170557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:18.174208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.184043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39290cca-e93c-410c-8616-3c94438d90d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:18.185992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39290cca-e93c-410c-8616-3c94438d90d4 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:18.204027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519155f3-ff38-4c0e-ba81-75a192d9c92f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:18.214193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:18.214815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 777/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:18.214931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.215132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.215403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] PATH_INFO: `/v3/projects/c7c06e800bf6447386cc8f485616f689` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.216897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c06e800bf6447386cc8f485616f689)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:18.218941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:18.318996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c06e800bf6447386cc8f485616f689', 'request_id': 'req-f9be0866-7d66-4092-9498-b1b2f4b9384b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.342105 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c06e800bf6447386cc8f485616f689', 'request_id': 'req-f9be0866-7d66-4092-9498-b1b2f4b9384b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.351477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c06e800bf6447386cc8f485616f689', 'request_id': 'req-f9be0866-7d66-4092-9498-b1b2f4b9384b'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.368737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] The token cache is being invalidate because project c7c06e800bf6447386cc8f485616f689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:18.369111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.370002 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f9be0866-7d66-4092-9498-b1b2f4b9384b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.375678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 748/1525] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:18 2022] DELETE /identity/v3/projects/c7c06e800bf6447386cc8f485616f689 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:18.377776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e43895-68aa-4687-b468-8efbae02e976 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.378240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e43895-68aa-4687-b468-8efbae02e976 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.378510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e43895-68aa-4687-b468-8efbae02e976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.404096 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d1e43895-68aa-4687-b468-8efbae02e976 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:18.405551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d1e43895-68aa-4687-b468-8efbae02e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.484112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 778/1526] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:18.491850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d449-1354-4e27-8b38-5c3464d22a5f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.492144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d449-1354-4e27-8b38-5c3464d22a5f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.492440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d449-1354-4e27-8b38-5c3464d22a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.517312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-50a9d449-1354-4e27-8b38-5c3464d22a5f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:18.519349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-50a9d449-1354-4e27-8b38-5c3464d22a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.529898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 749/1527] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:18.535762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e43895-68aa-4687-b468-8efbae02e976 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:18.556953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e43895-68aa-4687-b468-8efbae02e976 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:18.562872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:18.563506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.563781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.564108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.564964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:18.565323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:18.567881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:18.609141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 779/1528] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:18.610343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d449-1354-4e27-8b38-5c3464d22a5f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:18.622140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d449-1354-4e27-8b38-5c3464d22a5f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:18.633688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:18.634922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.637361 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.639051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.641832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:18.646587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:18.677068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:18.679582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.696335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:18.704572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13b549-031f-4a0d-afb9-a98d76a0af5b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:18.726785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:18.727884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.728350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.728867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] PATH_INFO: `/v3/projects/a33d62f060f840198dcd73d8c7323ed6` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.733931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a33d62f060f840198dcd73d8c7323ed6)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:18.742545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:18.750505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 750/1529] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:18 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:18.754208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:18.813041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:18.842448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a33d62f060f840198dcd73d8c7323ed6', 'request_id': 'req-badd941a-5145-489b-b604-19b2cf329821'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.856972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16e7f6-4fbc-4a83-a699-8fb61a455963 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:18.861315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a33d62f060f840198dcd73d8c7323ed6', 'request_id': 'req-badd941a-5145-489b-b604-19b2cf329821'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.868865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a33d62f060f840198dcd73d8c7323ed6', 'request_id': 'req-badd941a-5145-489b-b604-19b2cf329821'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.893486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] The token cache is being invalidate because project a33d62f060f840198dcd73d8c7323ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:18.893782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.894428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-badd941a-5145-489b-b604-19b2cf329821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:18.899418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 780/1530] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:18 2022] DELETE /identity/v3/projects/a33d62f060f840198dcd73d8c7323ed6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:18.901605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682835a-1c28-46d4-aa64-a4cc9d8d2d26 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.901890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682835a-1c28-46d4-aa64-a4cc9d8d2d26 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.902209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682835a-1c28-46d4-aa64-a4cc9d8d2d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.923430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:18.924057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.924345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.924595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.925607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:18.927626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:18.928896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a682835a-1c28-46d4-aa64-a4cc9d8d2d26 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:18.930175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a682835a-1c28-46d4-aa64-a4cc9d8d2d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.943224 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 781/1531] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:18.951181 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d70c6-1813-48d1-bda8-0461e28e1488 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:18.951464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d70c6-1813-48d1-bda8-0461e28e1488 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:18.953087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d70c6-1813-48d1-bda8-0461e28e1488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:18.967328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 751/1532] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:18 2022] POST /identity/v3/users => generated 291 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:18.971949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:18.974004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.993882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aecac3-e0be-4fdd-8c22-cd32372bd8dd admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:18.996869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d37d70c6-1813-48d1-bda8-0461e28e1488 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:18.999029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d37d70c6-1813-48d1-bda8-0461e28e1488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:18.999981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.000682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.001026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.001489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.002387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.004144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.011049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 782/1533] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:19.016545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d70c6-1813-48d1-bda8-0461e28e1488 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.020349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 752/1534] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:19.024634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.031621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d70c6-1813-48d1-bda8-0461e28e1488 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.043979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b7213-8531-4d74-bd3a-84a780e676cb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.045848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f88044-ff30-4428-9092-264417192160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.046480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f88044-ff30-4428-9092-264417192160 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.046750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f88044-ff30-4428-9092-264417192160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.047016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f88044-ff30-4428-9092-264417192160 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.047727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f88044-ff30-4428-9092-264417192160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:19.048032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f88044-ff30-4428-9092-264417192160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.049712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f88044-ff30-4428-9092-264417192160 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.060172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.060908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.061256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.061612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.062348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.064071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.079265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 783/1535] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:19.080450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f88044-ff30-4428-9092-264417192160 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.087400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 753/1536] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:19.091817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.098526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f88044-ff30-4428-9092-264417192160 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.110389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20498c-60d2-41a0-8538-961b2b7f6d07 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.111339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.112082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.112427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.112767 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.113613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.116600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3109-9e8d-442a-a4f5-abcbc83828e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.117289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3109-9e8d-442a-a4f5-abcbc83828e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.117598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3109-9e8d-442a-a4f5-abcbc83828e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.118318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.118758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3109-9e8d-442a-a4f5-abcbc83828e7 admin admin] PATH_INFO: `/v3/projects/f8b4e9ef26c54d1aba7cd41af4f12a7b/users/089966b6b49946b2a1bd28a0db3c17e8/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.141802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3109-9e8d-442a-a4f5-abcbc83828e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b4e9ef26c54d1aba7cd41af4f12a7b, user_id=089966b6b49946b2a1bd28a0db3c17e8, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.145464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3109-9e8d-442a-a4f5-abcbc83828e7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.173510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 754/1537] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:19 2022] PUT /identity/v3/projects/f8b4e9ef26c54d1aba7cd41af4f12a7b/users/089966b6b49946b2a1bd28a0db3c17e8/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:19.180970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8418b-5b9b-49f7-8fae-0023248328f8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.183440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8418b-5b9b-49f7-8fae-0023248328f8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.183440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8418b-5b9b-49f7-8fae-0023248328f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.202323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 784/1538] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:19 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:19.206458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.256143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4eb8418b-5b9b-49f7-8fae-0023248328f8 None None] MFA Rules not processed for user `089966b6b49946b2a1bd28a0db3c17e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:19.257549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4eb8418b-5b9b-49f7-8fae-0023248328f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:19.337478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:19.340225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588405eb-5e03-4959-b8e6-ad80dc0c1191 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.350844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.351637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.352120 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.352395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.353031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.355880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.405613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 755/1539] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:19.406734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8418b-5b9b-49f7-8fae-0023248328f8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.414026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 785/1540] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:19 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:19.418425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8418b-5b9b-49f7-8fae-0023248328f8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.423253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.423874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.424156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.424417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.425127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.428199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.431727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.447999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0ba61-312a-43ec-b6a9-f61917f9be1c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.457838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.458737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.459214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.459560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.460359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.462284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.465688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 756/1541] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:19 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:19.467772 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.474509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:19.480832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 786/1542] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:19.481670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.510696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73ce48-a7ce-43d0-9259-0f617e1277fb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.599582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccb403-2522-45e3-b9f8-da3e839d9efb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.615302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.617158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.617823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.618905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] PATH_INFO: `/v3/users/14a34884c69f4e079e43a2c1548810db` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.625460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14a34884c69f4e079e43a2c1548810db)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.629005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:19.631622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.665601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.666416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.666732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.667002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.667811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.669933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.705367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 787/1543] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:19 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:19.706115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.740392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e35b92-15e8-415b-8640-f22f003aa701 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.749268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.749951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.750231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.750782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.752229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.754577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.755004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14a34884c69f4e079e43a2c1548810db'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:19.776494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 788/1544] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:19.778212 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.780492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14a34884c69f4e079e43a2c1548810db'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:19.781478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14a34884c69f4e079e43a2c1548810db'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:19.793946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14a34884c69f4e079e43a2c1548810db'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:19.795525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14a34884c69f4e079e43a2c1548810db'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:19.814179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70abbe-b545-484e-ad13-a903a44d6024 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.828272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 757/1545] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:19 2022] DELETE /identity/v3/users/14a34884c69f4e079e43a2c1548810db => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:19.830619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.832737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b31bf3-094c-4ba2-8dd2-ba83d11c1609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.833886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31bf3-094c-4ba2-8dd2-ba83d11c1609 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.834178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31bf3-094c-4ba2-8dd2-ba83d11c1609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.834400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:19.834499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b31bf3-094c-4ba2-8dd2-ba83d11c1609 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.835570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31bf3-094c-4ba2-8dd2-ba83d11c1609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.837633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b31bf3-094c-4ba2-8dd2-ba83d11c1609 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.865305 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 789/1546] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:19.867404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.867692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.867968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.893516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:19.894624 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:19.894810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:19.946671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01941943-f282-46de-89c6-17cf39a9c8c6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.951996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:19.952305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:19.952586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:19.952859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] PATH_INFO: `/v3/projects/e14d97a5dc744815832cca95e36c31dc/users/2226f4aec3b04fedbc4151e6b0ae4817/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:19.970733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 790/1547] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:19.974153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e14d97a5dc744815832cca95e36c31dc, user_id=2226f4aec3b04fedbc4151e6b0ae4817, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:19.974594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:19.975619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.977128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:19.989966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43569b-7d70-4066-bedc-a3b31034b4c0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:19.991466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 758/1548] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:19 2022] PUT /identity/v3/projects/e14d97a5dc744815832cca95e36c31dc/users/2226f4aec3b04fedbc4151e6b0ae4817/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:19.992445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:19.994464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:20.048925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c86e65-ebe4-47c0-97a5-87da2696e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:20.049629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86e65-ebe4-47c0-97a5-87da2696e437 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.049944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86e65-ebe4-47c0-97a5-87da2696e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.050214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c86e65-ebe4-47c0-97a5-87da2696e437 admin admin] PATH_INFO: `/v3/projects/6899900c973e4dce97a591f2792d237a/users/58e2f966c712400dad87ac6e26612900/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.055556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf575d-f06b-4f15-ac79-e2d972183714 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:20.059200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:20.061018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.061295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.061596 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.064694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c86e65-ebe4-47c0-97a5-87da2696e437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6899900c973e4dce97a591f2792d237a, user_id=58e2f966c712400dad87ac6e26612900, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:20.067700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c86e65-ebe4-47c0-97a5-87da2696e437 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:20.071019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:20.072483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:20.081999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 791/1549] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:19 2022] PUT /identity/v3/projects/6899900c973e4dce97a591f2792d237a/users/58e2f966c712400dad87ac6e26612900/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:20.083529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.083902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.084167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.085828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 759/1550] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:20.086527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:20.096054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa67a86-2046-49ed-8295-2a095a799413 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:20.115549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] MFA Rules not processed for user `2226f4aec3b04fedbc4151e6b0ae4817`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:20.117456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:20.149988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:20.170595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:20.171513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.172031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.172394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.173217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:20.175126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:20.192813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 760/1551] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:20.197236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:20.212650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ac11a-be22-411b-9dcb-9d8b2102e198 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:20.221441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 792/1552] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:20.222845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4fd80-3da5-476a-904c-f8e04fe480bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:20.224203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4fd80-3da5-476a-904c-f8e04fe480bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.224860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4fd80-3da5-476a-904c-f8e04fe480bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.225226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4fd80-3da5-476a-904c-f8e04fe480bc admin admin] PATH_INFO: `/v3/projects/6899900c973e4dce97a591f2792d237a/users/58e2f966c712400dad87ac6e26612900/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.241505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4fd80-3da5-476a-904c-f8e04fe480bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6899900c973e4dce97a591f2792d237a, user_id=58e2f966c712400dad87ac6e26612900, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:20.244405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4fd80-3da5-476a-904c-f8e04fe480bc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:20.245624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:20.247812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:20.317590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 761/1553] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:20 2022] PUT /identity/v3/projects/6899900c973e4dce97a591f2792d237a/users/58e2f966c712400dad87ac6e26612900/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:20.319385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.319775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.320149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.362941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] MFA Rules not processed for user `58e2f966c712400dad87ac6e26612900`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:20.364918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:20.440330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:20.514720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cc728-433c-48cf-bee3-eda66ba96a22 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:20.581946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:20.582907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.583028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.583279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.623301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 762/1554] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:20.640311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:20.644769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:20.676779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:20.680374 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:20.719142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 793/1555] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:20.814365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdf3e6-8158-4ed8-b47e-334edfbce26e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:20.822143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:20.822898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:20.823269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:20.823631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:20.837703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:20.839846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:20.851609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 763/1556] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:21.025331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:21.041656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad76391-8a0b-4e16-932f-83c916971fe1 service glance] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:21.063526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:21.064159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:21.068998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:21.069289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:21.076539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:21.110330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:21.130835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:21.133970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:21.231974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:21.233613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:21.264565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 794/1557] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:21.274454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4226ad-d77a-4537-9409-5207f8b6a69c service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:21.280018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:21.280799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:21.281135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:21.281514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] PATH_INFO: `/v3/projects/2387d203d2da471ba3ed3e6ade67ffdf` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:21.282889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2387d203d2da471ba3ed3e6ade67ffdf)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:21.285484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:21.454863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2387d203d2da471ba3ed3e6ade67ffdf', 'request_id': 'req-031d4766-e30d-49c8-9efb-3c4e7a38ee14'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.473345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2387d203d2da471ba3ed3e6ade67ffdf', 'request_id': 'req-031d4766-e30d-49c8-9efb-3c4e7a38ee14'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.492918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2387d203d2da471ba3ed3e6ade67ffdf', 'request_id': 'req-031d4766-e30d-49c8-9efb-3c4e7a38ee14'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.505904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:21.532137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] The token cache is being invalidate because project 2387d203d2da471ba3ed3e6ade67ffdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:21.532426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.533752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.550761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 764/1558] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:21 2022] DELETE /identity/v3/projects/2387d203d2da471ba3ed3e6ade67ffdf => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:21.555735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:21.579940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed81287-a69a-4fa4-986e-6d6cf43b0ec8 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:21.743897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:21.744591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:21.744849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:21.745121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] PATH_INFO: `/v3/users/26604493998b43a4b743b507722ba6cf` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:21.748364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26604493998b43a4b743b507722ba6cf)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:21.750338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:21.831546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26604493998b43a4b743b507722ba6cf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.831546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26604493998b43a4b743b507722ba6cf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.831789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26604493998b43a4b743b507722ba6cf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.839696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:21.845792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:21.847954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26604493998b43a4b743b507722ba6cf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.855354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6bee46dc-ed95-417e-8540-318a97474747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26604493998b43a4b743b507722ba6cf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.861280 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d4766-e30d-49c8-9efb-3c4e7a38ee14 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:21.867577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:21.868489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:21.869421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:21.869788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] PATH_INFO: `/v3/users/089966b6b49946b2a1bd28a0db3c17e8` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:21.870921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] RBAC: Authorizing `identity:delete_user(user_id=089966b6b49946b2a1bd28a0db3c17e8)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:21.873420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 795/1559] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:21 2022] DELETE /identity/v3/users/26604493998b43a4b743b507722ba6cf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:21.873549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:21.957579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '089966b6b49946b2a1bd28a0db3c17e8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.973936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '089966b6b49946b2a1bd28a0db3c17e8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.974669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '089966b6b49946b2a1bd28a0db3c17e8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.984207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '089966b6b49946b2a1bd28a0db3c17e8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:21.984928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '089966b6b49946b2a1bd28a0db3c17e8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:22.015387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:22.015576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:22.015879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:22.020244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 765/1560] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:21 2022] DELETE /identity/v3/users/089966b6b49946b2a1bd28a0db3c17e8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:22.041905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:22.043222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:22.099914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:22.154945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 796/1561] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:22.170285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:22.186710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:22.361137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77171b-ebe2-4045-a0a0-e06ab07d162d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:22.366545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f88b8-ae9f-4513-a0d4-9762bed83798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:22.369141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f88b8-ae9f-4513-a0d4-9762bed83798 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:22.369464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f88b8-ae9f-4513-a0d4-9762bed83798 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:22.369740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f88b8-ae9f-4513-a0d4-9762bed83798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:22.385661 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f88b8-ae9f-4513-a0d4-9762bed83798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:22.387127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f88b8-ae9f-4513-a0d4-9762bed83798 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:22.400354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 766/1562] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:23.028398 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.032002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:23.045643 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb66fb-446c-4eb3-a399-401ad2ffe02d None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.050589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.051256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.051535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.051814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] PATH_INFO: `/v3/projects/e99f5cc3113e4de69f83c890d57b0b4f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.052996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99f5cc3113e4de69f83c890d57b0b4f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.055113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.123988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99f5cc3113e4de69f83c890d57b0b4f', 'request_id': 'req-4851e867-b23a-4851-8917-509730ef8dd4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.140368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99f5cc3113e4de69f83c890d57b0b4f', 'request_id': 'req-4851e867-b23a-4851-8917-509730ef8dd4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.148109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99f5cc3113e4de69f83c890d57b0b4f', 'request_id': 'req-4851e867-b23a-4851-8917-509730ef8dd4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.169974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] The token cache is being invalidate because project e99f5cc3113e4de69f83c890d57b0b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:23.170312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.171080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.173308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 797/1563] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:23 2022] DELETE /identity/v3/projects/e99f5cc3113e4de69f83c890d57b0b4f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:23.179282 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812988-3cd8-4178-97dc-a158bde1b8d4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.179796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812988-3cd8-4178-97dc-a158bde1b8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.179900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812988-3cd8-4178-97dc-a158bde1b8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.202565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-35812988-3cd8-4178-97dc-a158bde1b8d4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:23.204050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-35812988-3cd8-4178-97dc-a158bde1b8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:23.246304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.247900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:23.315493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 767/1564] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:23.324761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248579-9d91-4482-ad47-cb690559dc99 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.326270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248579-9d91-4482-ad47-cb690559dc99 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.326842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6248579-9d91-4482-ad47-cb690559dc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.352825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e6248579-9d91-4482-ad47-cb690559dc99 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:23.354392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e6248579-9d91-4482-ad47-cb690559dc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:23.362076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851e867-b23a-4851-8917-509730ef8dd4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.369235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 768/1565] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:23.369570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.370241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.370521 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.370796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] PATH_INFO: `/v3/projects/f8b4e9ef26c54d1aba7cd41af4f12a7b` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.371631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6248579-9d91-4482-ad47-cb690559dc99 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.372004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b4e9ef26c54d1aba7cd41af4f12a7b)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.375543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.376709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:23.385973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6248579-9d91-4482-ad47-cb690559dc99 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.398881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.399902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.400285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.400720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.401964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:23.402380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.404751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.422049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 769/1566] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:23.426498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.443902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d783e-8ac3-4fbb-a2d6-431112d6df34 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.450546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.451178 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.457757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.458153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.461037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.461248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.489667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b4e9ef26c54d1aba7cd41af4f12a7b', 'request_id': 'req-03cb5798-0a82-46dc-8201-6450cba6a074'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.498424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b4e9ef26c54d1aba7cd41af4f12a7b', 'request_id': 'req-03cb5798-0a82-46dc-8201-6450cba6a074'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.505204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 770/1567] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:23 2022] POST /identity/v3/projects => generated 393 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:23.506921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.508273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:23.510073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b4e9ef26c54d1aba7cd41af4f12a7b', 'request_id': 'req-03cb5798-0a82-46dc-8201-6450cba6a074'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.531141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] The token cache is being invalidate because project f8b4e9ef26c54d1aba7cd41af4f12a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:23.531558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.532342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.534354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 798/1568] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:23 2022] DELETE /identity/v3/projects/f8b4e9ef26c54d1aba7cd41af4f12a7b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:23.539399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.541618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:23.581623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee74e3-55b3-4d84-aaec-105f721e0207 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.589553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.590181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.590461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.590734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.591376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.594447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.618426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb5798-0a82-46dc-8201-6450cba6a074 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.624279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 771/1569] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:23 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:23.626248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.631338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.632256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.632850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.632992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] PATH_INFO: `/v3/users/58e2f966c712400dad87ac6e26612900` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.634061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:23.634454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58e2f966c712400dad87ac6e26612900)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.636243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.650542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c3f7c-a4e5-44d0-8509-852939443830 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.655768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.656453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.656800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.657137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.658026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.660029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.678690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 772/1570] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:23.684232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.694070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58e2f966c712400dad87ac6e26612900'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.694761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58e2f966c712400dad87ac6e26612900'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.695404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58e2f966c712400dad87ac6e26612900'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.697615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb979b-f277-4a34-9dc6-16cfb552e04b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.703900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.704680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.704984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.705631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.706621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.708208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.710279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58e2f966c712400dad87ac6e26612900'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.718226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bcfeb7c5-b2bc-4808-b14d-6971979ae891 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58e2f966c712400dad87ac6e26612900'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:23.722764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 773/1571] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:23.725085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:23.726920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:23.740150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 799/1572] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:23 2022] DELETE /identity/v3/users/58e2f966c712400dad87ac6e26612900 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:23.741916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb88e56-deba-48ec-b6af-c235c5996c01 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:23.826746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:23.827771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.828237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.828521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] PATH_INFO: `/v3/projects/96ac13c3768f4d7c9af8a9a3b4053532/users/4a481d0079634b439da26d44ef5db53e/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.851986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ac13c3768f4d7c9af8a9a3b4053532, user_id=4a481d0079634b439da26d44ef5db53e, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:23.855477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:23.872830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 774/1573] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:23 2022] PUT /identity/v3/projects/96ac13c3768f4d7c9af8a9a3b4053532/users/4a481d0079634b439da26d44ef5db53e/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:23.884339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bd3b-289f-447f-ab7a-22e57c0e109a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:23.884801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bd3b-289f-447f-ab7a-22e57c0e109a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:23.885902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c9bd3b-289f-447f-ab7a-22e57c0e109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:23.961884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f9c9bd3b-289f-447f-ab7a-22e57c0e109a None None] MFA Rules not processed for user `4a481d0079634b439da26d44ef5db53e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:23.963221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f9c9bd3b-289f-447f-ab7a-22e57c0e109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:24.048364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:24.059916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 800/1574] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:24.061701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.082300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:24.129494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5845321-6b80-459b-a95d-b9b5145a5926 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.136045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:24.136794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.137156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.138441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.138441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:24.140458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:24.194637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 775/1575] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:24 2022] POST /identity/v3/projects => generated 393 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:24.198998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9bd3b-289f-447f-ab7a-22e57c0e109a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.211143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.213347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:24.220001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c9bd3b-289f-447f-ab7a-22e57c0e109a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.303057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:24.305420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.305864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.306879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.307731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:24.309901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:24.313468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee0bf3-3665-44ca-873a-1ed1093b44ac admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.330541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:24.331643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.332136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.332584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] PATH_INFO: `/v3/projects/6899900c973e4dce97a591f2792d237a` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.337892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6899900c973e4dce97a591f2792d237a)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:24.338978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:24.349913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 801/1576] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:24 2022] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:24.354223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.378851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbea734-d2e1-41ff-b183-2c60c299b14a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.391052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:24.392063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.392585 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.393006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.393921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:24.397676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:24.412761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6899900c973e4dce97a591f2792d237a', 'request_id': 'req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:24.414007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 802/1577] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:24.422394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.425502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6899900c973e4dce97a591f2792d237a', 'request_id': 'req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:24.433470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6899900c973e4dce97a591f2792d237a', 'request_id': 'req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:24.441831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919a35f-21ce-4bcb-9c4d-63358cbacb2a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.459895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] The token cache is being invalidate because project 6899900c973e4dce97a591f2792d237a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:24.460720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:24.462193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-875eb66c-e098-4fa8-9d35-1a81a3f01cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:24.463974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 776/1578] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:24 2022] DELETE /identity/v3/projects/6899900c973e4dce97a591f2792d237a => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:24.471253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b1964-5f23-461c-9636-5d47f6ff6327 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.471428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b1964-5f23-461c-9636-5d47f6ff6327 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.471759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b1964-5f23-461c-9636-5d47f6ff6327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.495376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b30b1964-5f23-461c-9636-5d47f6ff6327 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:24.497416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b30b1964-5f23-461c-9636-5d47f6ff6327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:24.535207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:24.536060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.536341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.536581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] PATH_INFO: `/v3/projects/c3d818c37f1c4e49a694d7fa3b09a8dc/users/2c860bf1f16944f584ba1b193baae7c1/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.560314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:24.578049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d818c37f1c4e49a694d7fa3b09a8dc, user_id=2c860bf1f16944f584ba1b193baae7c1, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:24.581295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:24.605662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 803/1579] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:24 2022] PUT /identity/v3/projects/c3d818c37f1c4e49a694d7fa3b09a8dc/users/2c860bf1f16944f584ba1b193baae7c1/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:24.611249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.614770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:24.653027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 777/1580] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:24.654641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c58e5-0450-48ce-9373-99493e4bc290 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.654948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c58e5-0450-48ce-9373-99493e4bc290 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.655222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c58e5-0450-48ce-9373-99493e4bc290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.689192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-bb2c58e5-0450-48ce-9373-99493e4bc290 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:24.690476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-bb2c58e5-0450-48ce-9373-99493e4bc290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:24.732653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13180b-ad0d-4026-9c42-4fdb34cd5838 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.743964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:24.744756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.745037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.745305 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.746689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:24.748400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:24.749983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:24.776883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 804/1581] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:24.786660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.813872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5dd0c4-d904-4378-8488-c8f93bb4c84a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.823144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0386d68-52b9-436e-a5ad-533579d6a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:24.824569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386d68-52b9-436e-a5ad-533579d6a05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.824859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386d68-52b9-436e-a5ad-533579d6a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.825135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0386d68-52b9-436e-a5ad-533579d6a05b admin admin] PATH_INFO: `/v3/projects/c3d818c37f1c4e49a694d7fa3b09a8dc/users/2c860bf1f16944f584ba1b193baae7c1/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.828077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0386d68-52b9-436e-a5ad-533579d6a05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d818c37f1c4e49a694d7fa3b09a8dc, user_id=2c860bf1f16944f584ba1b193baae7c1, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:24.831136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0386d68-52b9-436e-a5ad-533579d6a05b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:24.859541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 805/1582] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:24 2022] PUT /identity/v3/projects/c3d818c37f1c4e49a694d7fa3b09a8dc/users/2c860bf1f16944f584ba1b193baae7c1/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:24.862488 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:24.862787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:24.863337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:24.866652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 778/1583] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:24.872098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c58e5-0450-48ce-9373-99493e4bc290 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:24.888838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c58e5-0450-48ce-9373-99493e4bc290 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:24.932023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] MFA Rules not processed for user `2c860bf1f16944f584ba1b193baae7c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:24.934844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:25.012138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.012762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.013043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.013708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.014118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:25.014421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.016054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.033913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 779/1584] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:25.046251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.059115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f280c6-5926-4614-8e2e-a6ff40e482e1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.066184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.067221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.067717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.068242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.069604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.071770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.078922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 806/1585] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:25.093214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.095713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:25.126224 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 780/1586] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:25 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:25.130901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.181627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a3743-3fcc-4259-90d8-ba0e1fa87eff None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.195172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:25.218412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe22b9-ab0e-4378-a447-5579be5fcccb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.225443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.227121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.227561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.228557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.229568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.232116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.261410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 781/1587] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:25 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:25.264764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.267012 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc670f8-f2aa-4916-8c24-69260eb9076f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.267955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc670f8-f2aa-4916-8c24-69260eb9076f service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.268457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc670f8-f2aa-4916-8c24-69260eb9076f service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.268937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc670f8-f2aa-4916-8c24-69260eb9076f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.278574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524978d-400f-4b5d-a626-4dce4bff5f2f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.283798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.284421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.284696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.285047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.285831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.287774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.303148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 782/1588] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:25.304542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.319663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b343ea-544a-4c44-91c1-bd54e3103ee5 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.325890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.326511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.326786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.327091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.327743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.329939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:25.332063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.350198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 783/1589] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:25.354698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.365835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de551135-7b26-4efc-97ab-f8eed86e59fe admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.375478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.377213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.377969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.381518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] PATH_INFO: `/v3/projects/f119224e8967410c99b9bd858ff09c4e/users/918d0897eae6470fbeaea6a4e0e79b9c/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.388925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc670f8-f2aa-4916-8c24-69260eb9076f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.390983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc670f8-f2aa-4916-8c24-69260eb9076f service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.407743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119224e8967410c99b9bd858ff09c4e, user_id=918d0897eae6470fbeaea6a4e0e79b9c, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.409170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 807/1590] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:25.411278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.445941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 784/1591] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:25 2022] PUT /identity/v3/projects/f119224e8967410c99b9bd858ff09c4e/users/918d0897eae6470fbeaea6a4e0e79b9c/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:25.446713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.446911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.447179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.485663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.499727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] MFA Rules not processed for user `918d0897eae6470fbeaea6a4e0e79b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:25.501768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:25.615003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 808/1592] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:25.638466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79191a-9d05-4194-81cc-8ffba74542df admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.642547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.643168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.643445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.643717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.646158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:25.754394 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.761519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.786885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 785/1593] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:25.865046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:25.866707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:25.889331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e2185-fed6-460a-89e7-03f617a4c67b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:25.894476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb98d0-cb18-43b9-a288-493f0c297ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:25.895118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb98d0-cb18-43b9-a288-493f0c297ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:25.895568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb98d0-cb18-43b9-a288-493f0c297ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:25.895849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb98d0-cb18-43b9-a288-493f0c297ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:25.912949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb98d0-cb18-43b9-a288-493f0c297ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:25.918200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb98d0-cb18-43b9-a288-493f0c297ac0 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:25.935936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 809/1594] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:28.790240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:28.850168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:28.870539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852252-a33e-4e17-aedd-687c1cd7edc4 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:28.875388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:28.876042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:28.876325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:28.876595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] PATH_INFO: `/v3/users/918d0897eae6470fbeaea6a4e0e79b9c` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:28.877977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=918d0897eae6470fbeaea6a4e0e79b9c)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:28.880383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:28.943278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '918d0897eae6470fbeaea6a4e0e79b9c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:28.958967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '918d0897eae6470fbeaea6a4e0e79b9c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:28.959722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '918d0897eae6470fbeaea6a4e0e79b9c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:28.967311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '918d0897eae6470fbeaea6a4e0e79b9c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:28.968077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '918d0897eae6470fbeaea6a4e0e79b9c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:28.983346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 786/1595] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:28 2022] DELETE /identity/v3/users/918d0897eae6470fbeaea6a4e0e79b9c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:28.988314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:28.988847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:28.988847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:29.011617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:29.012850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:29.089724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 810/1596] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:29.100259 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:29.101834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:29.168700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a03a51-86b8-4500-b751-8d16dc0acbbc admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:29.172599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:29.173223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:29.173533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:29.173971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:29.185584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:29.187112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:29.206233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 787/1597] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:29.779390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:29.780972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:29.794367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd69cc1-e30e-4958-96b2-895201e539f1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:29.799620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:29.800672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:29.801121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:29.801368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:29.801698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] PATH_INFO: `/v3/projects/f119224e8967410c99b9bd858ff09c4e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:29.801816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:29.802816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f119224e8967410c99b9bd858ff09c4e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:29.804781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:29.814900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97d2dc-c06f-4637-b35b-9e5e23161a7b service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:29.819934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:29.820566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:29.820901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:29.821123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] PATH_INFO: `/v3/users/4a481d0079634b439da26d44ef5db53e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:29.822283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a481d0079634b439da26d44ef5db53e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:29.824329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:29.868237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:29.871969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f119224e8967410c99b9bd858ff09c4e', 'request_id': 'req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.883313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f119224e8967410c99b9bd858ff09c4e', 'request_id': 'req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.891062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f119224e8967410c99b9bd858ff09c4e', 'request_id': 'req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.907076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] The token cache is being invalidate because project f119224e8967410c99b9bd858ff09c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:29.907519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.908273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2fd72990-40aa-4f5d-bfee-66ae73b7fa4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.910217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a481d0079634b439da26d44ef5db53e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.910654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 811/1598] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:29 2022] DELETE /identity/v3/projects/f119224e8967410c99b9bd858ff09c4e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:29.915334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a99a-df1b-49e6-8071-e976c9269567 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:29.915825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a99a-df1b-49e6-8071-e976c9269567 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:29.916032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5a99a-df1b-49e6-8071-e976c9269567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:29.923264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:29.925991 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a481d0079634b439da26d44ef5db53e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.927147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a481d0079634b439da26d44ef5db53e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.939840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1cb5a99a-df1b-49e6-8071-e976c9269567 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:29.941443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1cb5a99a-df1b-49e6-8071-e976c9269567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:29.942917 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a481d0079634b439da26d44ef5db53e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.943965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fbe2a4ce-09de-4940-b825-bc11f843d119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a481d0079634b439da26d44ef5db53e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:29.970478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 788/1599] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:29 2022] DELETE /identity/v3/users/4a481d0079634b439da26d44ef5db53e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:29.975164 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828897cb-d772-4562-9867-f2048615dbee None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:29.975445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828897cb-d772-4562-9867-f2048615dbee None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:29.975713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828897cb-d772-4562-9867-f2048615dbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:29.995444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-828897cb-d772-4562-9867-f2048615dbee None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:29.996668 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-828897cb-d772-4562-9867-f2048615dbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:30.012039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 812/1600] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:30.021498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249956c4-ce6e-4384-81f1-a0875fcf0f06 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.021780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249956c4-ce6e-4384-81f1-a0875fcf0f06 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.022163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249956c4-ce6e-4384-81f1-a0875fcf0f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.042548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-249956c4-ce6e-4384-81f1-a0875fcf0f06 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:30.043835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-249956c4-ce6e-4384-81f1-a0875fcf0f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:30.076389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 789/1601] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:30.084925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828897cb-d772-4562-9867-f2048615dbee None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.089698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-828897cb-d772-4562-9867-f2048615dbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:30.140550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 813/1602] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:30.145726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249956c4-ce6e-4384-81f1-a0875fcf0f06 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.156214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249956c4-ce6e-4384-81f1-a0875fcf0f06 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.161801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.162435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.162785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.162998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.163814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:30.164134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.164435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828897cb-d772-4562-9867-f2048615dbee None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.166398 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.173999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.174832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.175290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.175661 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.183260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 814/1603] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:30.187634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.190819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.192403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.200862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bc883-1253-439b-a5ad-43003b0af602 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.203391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 790/1604] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:30.206263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.206979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.207259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.207532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.208173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.210161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.257456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.257816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 815/1605] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:30 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:30.277201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150cd1a2-b432-44db-8672-49d1669b8f1f service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.370894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.379360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.379694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.380378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.381096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.383398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.417824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 791/1606] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:30 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:30.418302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.430309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3b0e-8f3b-4db9-9ce6-eba81b282149 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.436902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.437704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.438076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.438468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.439243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.441140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.462966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 816/1607] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:30.466604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.483977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f046f12-4346-4beb-b628-274ff6f492e3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.491804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80074c3b-355f-4d06-a980-87c0cb8c2933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.492690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074c3b-355f-4d06-a980-87c0cb8c2933 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.493199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074c3b-355f-4d06-a980-87c0cb8c2933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.493676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80074c3b-355f-4d06-a980-87c0cb8c2933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.494487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074c3b-355f-4d06-a980-87c0cb8c2933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.496838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80074c3b-355f-4d06-a980-87c0cb8c2933 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.503592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:30.514485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.515066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 792/1608] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:30.527891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46d374d-6ef8-4ea7-890e-0da04ef4f6be admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.554412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.555191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.555473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.555749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] PATH_INFO: `/v3/projects/33b66de33cff415e937d6a2649ef0653/users/2d381bb199f24e1eb02f458466f73273/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.581009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33b66de33cff415e937d6a2649ef0653, user_id=2d381bb199f24e1eb02f458466f73273, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.585930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.615384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 817/1609] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:30 2022] PUT /identity/v3/projects/33b66de33cff415e937d6a2649ef0653/users/2d381bb199f24e1eb02f458466f73273/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:30.621032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.621810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.622288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.687643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] MFA Rules not processed for user `2d381bb199f24e1eb02f458466f73273`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:30.690228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:30.780647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.782579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:30.798816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:30.856230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 793/1610] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:30.864429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.866161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:30.909042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19404d-0259-429a-8364-d4c9bc06c620 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.914812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.915893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.916513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.916991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] PATH_INFO: `/v3/projects/96ac13c3768f4d7c9af8a9a3b4053532` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.922701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ac13c3768f4d7c9af8a9a3b4053532)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.925974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.931429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2867f-2014-40c7-8da0-97b471592e3e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:30.935227 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:30.936172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:30.936726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:30.937211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:30.951918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:30.953444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:30.963375 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 794/1611] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:30.993124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ac13c3768f4d7c9af8a9a3b4053532', 'request_id': 'req-7c693912-8d98-4c30-a3b8-f8f83835d45b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:30.993321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:30.999035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ac13c3768f4d7c9af8a9a3b4053532', 'request_id': 'req-7c693912-8d98-4c30-a3b8-f8f83835d45b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.006654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ac13c3768f4d7c9af8a9a3b4053532', 'request_id': 'req-7c693912-8d98-4c30-a3b8-f8f83835d45b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.017709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36cbf5-08a7-4263-914d-b77d37f44652 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:31.036077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] The token cache is being invalidate because project 96ac13c3768f4d7c9af8a9a3b4053532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:31.036676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.037201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.042274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 818/1612] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:30 2022] DELETE /identity/v3/projects/96ac13c3768f4d7c9af8a9a3b4053532 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:31.045813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:31.047204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:31.155236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:31.155896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:31.156347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:31.156440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] PATH_INFO: `/v3/users/2d381bb199f24e1eb02f458466f73273` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:31.159857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d381bb199f24e1eb02f458466f73273)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:31.164635 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:31.220212 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c693912-8d98-4c30-a3b8-f8f83835d45b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:31.234114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:31.234963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:31.235370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:31.235853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] PATH_INFO: `/v3/users/2c860bf1f16944f584ba1b193baae7c1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:31.237205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c860bf1f16944f584ba1b193baae7c1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:31.239422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:31.261599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:31.290159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d381bb199f24e1eb02f458466f73273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.321874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d381bb199f24e1eb02f458466f73273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.322650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d381bb199f24e1eb02f458466f73273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.343613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:31.363970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d381bb199f24e1eb02f458466f73273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.366811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a46c99b5-40d0-4f10-a47b-0324b7df1d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d381bb199f24e1eb02f458466f73273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.367787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c860bf1f16944f584ba1b193baae7c1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.368639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c860bf1f16944f584ba1b193baae7c1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.369562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c860bf1f16944f584ba1b193baae7c1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.388218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c860bf1f16944f584ba1b193baae7c1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.403028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c860bf1f16944f584ba1b193baae7c1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:31.406690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 795/1613] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:30 2022] DELETE /identity/v3/users/2d381bb199f24e1eb02f458466f73273 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:31.414011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:31.414280 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:31.414553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:31.434937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 819/1614] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:31 2022] DELETE /identity/v3/users/2c860bf1f16944f584ba1b193baae7c1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:31.485983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:31.487202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:31.611025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 796/1615] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:31.624217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:31.625811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:31.751318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a3335-ae57-4a7e-99f0-b50d6b8b8573 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:31.757316 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:31.757987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:31.758266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:31.758593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:31.771257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:31.773415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:31.815146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 820/1616] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:32.771341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:32.773648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:32.787047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979626be-c894-4d75-8a78-048d69ff2e7d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:32.792297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:32.793067 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:32.793411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:32.793777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] PATH_INFO: `/v3/projects/c3d818c37f1c4e49a694d7fa3b09a8dc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:32.795136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d818c37f1c4e49a694d7fa3b09a8dc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:32.797168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:32.870046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:32.872960 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:32.903737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbfa3e-bca1-44f9-b30e-00dc37b848a0 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:32.913822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d818c37f1c4e49a694d7fa3b09a8dc', 'request_id': 'req-348e689f-115a-47bf-b849-7bb6b7a4b1d0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:32.923498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d818c37f1c4e49a694d7fa3b09a8dc', 'request_id': 'req-348e689f-115a-47bf-b849-7bb6b7a4b1d0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:32.930882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d818c37f1c4e49a694d7fa3b09a8dc', 'request_id': 'req-348e689f-115a-47bf-b849-7bb6b7a4b1d0'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:32.950397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] The token cache is being invalidate because project c3d818c37f1c4e49a694d7fa3b09a8dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:32.950597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:32.951376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-348e689f-115a-47bf-b849-7bb6b7a4b1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:32.953687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 797/1617] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:32 2022] DELETE /identity/v3/projects/c3d818c37f1c4e49a694d7fa3b09a8dc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:32.958704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee1c8-0139-4911-8d47-713e62d8b4dc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:32.959193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee1c8-0139-4911-8d47-713e62d8b4dc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:32.959542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee1c8-0139-4911-8d47-713e62d8b4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:32.976280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:32.977009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:32.977766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:32.977766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] PATH_INFO: `/v3/projects/33b66de33cff415e937d6a2649ef0653` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:32.978809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=33b66de33cff415e937d6a2649ef0653)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:32.980728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:32.984663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-58dee1c8-0139-4911-8d47-713e62d8b4dc None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:32.986069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-58dee1c8-0139-4911-8d47-713e62d8b4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:33.003153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 798/1618] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:33.011769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5cc8-bb08-43b5-aefe-52b630c8c58b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.012034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5cc8-bb08-43b5-aefe-52b630c8c58b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.012323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab5cc8-bb08-43b5-aefe-52b630c8c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.033132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3dab5cc8-bb08-43b5-aefe-52b630c8c58b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:33.034439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3dab5cc8-bb08-43b5-aefe-52b630c8c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:33.040687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33b66de33cff415e937d6a2649ef0653', 'request_id': 'req-9a253355-45f8-4d34-8814-a5979e3661ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.050435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33b66de33cff415e937d6a2649ef0653', 'request_id': 'req-9a253355-45f8-4d34-8814-a5979e3661ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.056519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:33.061972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33b66de33cff415e937d6a2649ef0653', 'request_id': 'req-9a253355-45f8-4d34-8814-a5979e3661ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.063404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:33.082372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] The token cache is being invalidate because project 33b66de33cff415e937d6a2649ef0653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:33.082913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.083728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:33.085489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 821/1619] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:32 2022] DELETE /identity/v3/projects/33b66de33cff415e937d6a2649ef0653 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:33.143303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 799/1620] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:33.146735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.164007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253355-45f8-4d34-8814-a5979e3661ac admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.175029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.176000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.176472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.176836 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.177666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:33.178060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.181416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.203294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 822/1621] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:33.207260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5cc8-bb08-43b5-aefe-52b630c8c58b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.219442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab5cc8-bb08-43b5-aefe-52b630c8c58b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.226843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.227877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.228356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.228630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.229349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.231891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.280525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 800/1622] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:33 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:33.282064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.301438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc0ec9-da60-4aa3-a944-1d2393be9d1e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.402993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.404324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.404324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.404324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.404790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.407030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.431884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 823/1623] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:33 2022] POST /identity/v3/users => generated 284 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:33.436206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.447424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f0dec-e444-45df-86e9-21ad761dd282 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.452205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.452819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.453190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.453499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.454052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.455718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.471021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 801/1624] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:33.473320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.490177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08945155-cb46-4e89-9a78-8f10bdbf481a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.495388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209cea8-4039-4ccf-8239-1e05b85f35ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.496153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209cea8-4039-4ccf-8239-1e05b85f35ba admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.496430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209cea8-4039-4ccf-8239-1e05b85f35ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.496694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209cea8-4039-4ccf-8239-1e05b85f35ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.497354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209cea8-4039-4ccf-8239-1e05b85f35ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.499021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209cea8-4039-4ccf-8239-1e05b85f35ba admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.511579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 824/1625] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:33.516103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.527232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4604424-8a7f-47a8-806d-85232e4a0073 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.532408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.533154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.533480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.533801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] PATH_INFO: `/v3/projects/c3103d632e6a4f9395dec9f9e472e87f/users/9de0af2a66044689905462fa08db17b8/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.550494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3103d632e6a4f9395dec9f9e472e87f, user_id=9de0af2a66044689905462fa08db17b8, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.553129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.593677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 802/1626] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:33 2022] PUT /identity/v3/projects/c3103d632e6a4f9395dec9f9e472e87f/users/9de0af2a66044689905462fa08db17b8/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:33.600279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d83-3a95-4d9e-af2e-4aec97f8c08d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.600529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d83-3a95-4d9e-af2e-4aec97f8c08d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.600802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc5d83-3a95-4d9e-af2e-4aec97f8c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.633919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1cbc5d83-3a95-4d9e-af2e-4aec97f8c08d None None] MFA Rules not processed for user `9de0af2a66044689905462fa08db17b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:33.635099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1cbc5d83-3a95-4d9e-af2e-4aec97f8c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:33.726743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 825/1627] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:33.741541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:33.743543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:33.842565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4d2c2-a357-4b2d-b7e1-73ef57abaed7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:33.848084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a1f1e-53fe-4399-a900-d38860dd49cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:33.848621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1f1e-53fe-4399-a900-d38860dd49cb service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:33.848802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1f1e-53fe-4399-a900-d38860dd49cb service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:33.849083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a1f1e-53fe-4399-a900-d38860dd49cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:33.858776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1f1e-53fe-4399-a900-d38860dd49cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:33.860229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2a1f1e-53fe-4399-a900-d38860dd49cb service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:33.870221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 803/1628] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:42.267932 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f631b0-8a95-482f-9ab1-1be01f170ac2 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:42.268800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f631b0-8a95-482f-9ab1-1be01f170ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:42.269097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f631b0-8a95-482f-9ab1-1be01f170ac2 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:42.270858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 826/1629] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 19:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 19:58:42.298758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ed01-d968-4571-ae2c-ffe11bb03c1e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:42.299742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ed01-d968-4571-ae2c-ffe11bb03c1e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:42.300169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46ed01-d968-4571-ae2c-ffe11bb03c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:42.327289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ad46ed01-d968-4571-ae2c-ffe11bb03c1e None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:42.328690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ad46ed01-d968-4571-ae2c-ffe11bb03c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:42.409248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f631b0-8a95-482f-9ab1-1be01f170ac2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:42.411213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f8f631b0-8a95-482f-9ab1-1be01f170ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:42.443822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 804/1630] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:42.451890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf450c-1881-492e-acec-32f7d230175f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:42.452436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf450c-1881-492e-acec-32f7d230175f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:42.453253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf450c-1881-492e-acec-32f7d230175f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:42.454741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 805/1631] 10.222.0.52 () {54 vars in 961 bytes} [Fri Oct 28 19:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 28 19:58:42.459976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa15d3c-b846-47c9-9f0b-ca6040227eec None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:42.460322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa15d3c-b846-47c9-9f0b-ca6040227eec None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:42.460670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa15d3c-b846-47c9-9f0b-ca6040227eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:42.482948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7aa15d3c-b846-47c9-9f0b-ca6040227eec None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:42.484161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7aa15d3c-b846-47c9-9f0b-ca6040227eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:42.493106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 806/1632] 10.222.0.52 () {58 vars in 1058 bytes} [Fri Oct 28 19:58:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:42.493560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:42.501576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa15d3c-b846-47c9-9f0b-ca6040227eec None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:42.509976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:42.515132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa15d3c-b846-47c9-9f0b-ca6040227eec None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:42.522245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:42.522868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:42.523138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:42.523407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:42.526250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f631b0-8a95-482f-9ab1-1be01f170ac2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:42.533602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:42.533715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:42.534321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:42.534610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:42.534882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] PATH_INFO: `/v3/users/584b959cf2224df5b526dfb6c45a7fe1` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:42.535223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:42.536124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=584b959cf2224df5b526dfb6c45a7fe1)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:42.538151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:42.549252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 807/1633] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:42.602652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584b959cf2224df5b526dfb6c45a7fe1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:42.603937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584b959cf2224df5b526dfb6c45a7fe1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:42.604837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584b959cf2224df5b526dfb6c45a7fe1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:42.623666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584b959cf2224df5b526dfb6c45a7fe1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:42.631914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584b959cf2224df5b526dfb6c45a7fe1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:42.650882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 827/1634] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:42 2022] DELETE /identity/v3/users/584b959cf2224df5b526dfb6c45a7fe1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:42.846750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:42.858556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d248f4-7896-4667-81e7-8df3999d3a20 service placement] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:42.921407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:42.922041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:42.922272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:42.922576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] PATH_INFO: `/v3/projects/0ebdcf0ac92a40a3ba8444d5482e48cf` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:42.923707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ebdcf0ac92a40a3ba8444d5482e48cf)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:42.925680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:42.982884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ebdcf0ac92a40a3ba8444d5482e48cf', 'request_id': 'req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:42.991237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ebdcf0ac92a40a3ba8444d5482e48cf', 'request_id': 'req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:42.998398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ebdcf0ac92a40a3ba8444d5482e48cf', 'request_id': 'req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.015521 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.016892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] The token cache is being invalidate because project 0ebdcf0ac92a40a3ba8444d5482e48cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:43.017194 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.017472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.017912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7795bf45-a16e-4a23-9f4f-84ff42ba5d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.019450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 808/1635] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:42 2022] DELETE /identity/v3/projects/0ebdcf0ac92a40a3ba8444d5482e48cf => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:43.024575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd996-7b4d-41f4-8a33-43e1e3eeec37 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.024853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd996-7b4d-41f4-8a33-43e1e3eeec37 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.025122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bd996-7b4d-41f4-8a33-43e1e3eeec37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.031783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce13fd-7717-4188-9705-d8e41a1c33fb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.047795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e12bd996-7b4d-41f4-8a33-43e1e3eeec37 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:43.049036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e12bd996-7b4d-41f4-8a33-43e1e3eeec37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.102035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.102692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.102976 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.103249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] PATH_INFO: `/v3/users/2226f4aec3b04fedbc4151e6b0ae4817` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.104413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2226f4aec3b04fedbc4151e6b0ae4817)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.106435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.124565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 809/1636] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:43.133413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf960b-8acc-4494-b6dc-d8623f43302c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.133796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf960b-8acc-4494-b6dc-d8623f43302c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.134136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf960b-8acc-4494-b6dc-d8623f43302c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.161780 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-10bf960b-8acc-4494-b6dc-d8623f43302c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:43.163555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-10bf960b-8acc-4494-b6dc-d8623f43302c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.171404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2226f4aec3b04fedbc4151e6b0ae4817'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.172075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 810/1637] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:43.173731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2226f4aec3b04fedbc4151e6b0ae4817'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.174371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2226f4aec3b04fedbc4151e6b0ae4817'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.176160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf960b-8acc-4494-b6dc-d8623f43302c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.186575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf960b-8acc-4494-b6dc-d8623f43302c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.186842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:43.193165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2226f4aec3b04fedbc4151e6b0ae4817'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.194149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.195066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.195522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.195966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.196970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:43.197476 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.200062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.204772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-102bf2be-70d3-47ea-8513-cf2ca20bdc8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2226f4aec3b04fedbc4151e6b0ae4817'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.218253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 811/1638] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:58:43.223083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.225188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.228078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 828/1639] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:43 2022] DELETE /identity/v3/users/2226f4aec3b04fedbc4151e6b0ae4817 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:43.233792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:43.240191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.240798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.241373 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.241876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e753344-7219-4c36-b842-0f3c2098d9ac admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.267058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:43.268443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.308056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.308748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.308936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.309211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.309891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.311827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.337187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 829/1640] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:43.348795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.350277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.354805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 812/1641] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:43.356600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.428969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa732f83-c01c-494c-b68b-53a86c57f2e7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.430025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99457b67-1368-4c60-b54a-87018aecd08c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.434839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.435494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.435775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.436381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.437151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.439115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.475389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 813/1642] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/users => generated 302 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:43.476719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.486818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06e731-f885-4ecb-88b8-ef0a38122bcd admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.491901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.492516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.493252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.493252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.493729 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.495403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.497197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.497851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.498240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.498970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.506547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 814/1643] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:43.509661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.510572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.511326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.533406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e2b04-ba06-4cc4-bd50-7a2d4cefc4df admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.533619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 830/1644] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:43.533702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110a8e0-749b-42d1-be17-f6435d941482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.533702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a8e0-749b-42d1-be17-f6435d941482 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.533702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a8e0-749b-42d1-be17-f6435d941482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.533702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110a8e0-749b-42d1-be17-f6435d941482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.534056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110a8e0-749b-42d1-be17-f6435d941482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.534056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110a8e0-749b-42d1-be17-f6435d941482 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.547562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 815/1645] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:43.552006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.562680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5977476-8e31-4cef-9664-e07aac260294 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.582493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.583258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.583537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.583807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] PATH_INFO: `/v3/projects/ccc4246fb7a34d30a70b3b3901d3af80/users/f99583bbf19b49e7875b05069cb08fc8/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.600383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccc4246fb7a34d30a70b3b3901d3af80, user_id=f99583bbf19b49e7875b05069cb08fc8, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.603191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.619226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 831/1646] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:43 2022] PUT /identity/v3/projects/ccc4246fb7a34d30a70b3b3901d3af80/users/f99583bbf19b49e7875b05069cb08fc8/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:43.629886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.630180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.630459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.660028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] MFA Rules not processed for user `f99583bbf19b49e7875b05069cb08fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:43.661314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.724039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:43.753752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 816/1647] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:43.759360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.794438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:43.859149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.861109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:43.865861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee795be4-a9ec-4f17-b7f8-e58ee7df30ad admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.870848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.871489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.871775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.872031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.872671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.877918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7ea41-e2b4-4fdd-8c78-05028d6d2388 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:43.883057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:43.883720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.883992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.884107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.884257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] PATH_INFO: `/v3/projects/e14d97a5dc744815832cca95e36c31dc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:43.886063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e14d97a5dc744815832cca95e36c31dc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:43.888242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:43.920819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 832/1648] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:43.922566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:43.950602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e14d97a5dc744815832cca95e36c31dc', 'request_id': 'req-0a5a48c5-2883-410c-87d5-6410c8e3cd02'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.957786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e14d97a5dc744815832cca95e36c31dc', 'request_id': 'req-0a5a48c5-2883-410c-87d5-6410c8e3cd02'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.964246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e14d97a5dc744815832cca95e36c31dc', 'request_id': 'req-0a5a48c5-2883-410c-87d5-6410c8e3cd02'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.979274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] The token cache is being invalidate because project e14d97a5dc744815832cca95e36c31dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:43.979571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.980228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0a5a48c5-2883-410c-87d5-6410c8e3cd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:43.986120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 817/1649] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:43 2022] DELETE /identity/v3/projects/e14d97a5dc744815832cca95e36c31dc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:43.987826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6a653-f1d0-451f-9b1b-ff453db37926 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:43.988111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6a653-f1d0-451f-9b1b-ff453db37926 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:43.988395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6a653-f1d0-451f-9b1b-ff453db37926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.005491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795038fe-f62b-4d51-bb5d-c1a38c34571a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.018430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-18d6a653-f1d0-451f-9b1b-ff453db37926 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:44.021554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-18d6a653-f1d0-451f-9b1b-ff453db37926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:44.076618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.077251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.077564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.077838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.078474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.080489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.104177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 833/1650] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/users => generated 309 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:44.117496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.117708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 818/1651] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:44.117853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:44.119869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cebadc-b788-402b-9b82-fc7dd913889c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.120212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cebadc-b788-402b-9b82-fc7dd913889c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.120606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cebadc-b788-402b-9b82-fc7dd913889c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.126298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820ad16-a4f9-4840-aecf-1cf5762583e2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.132753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.133433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.133795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.134148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.135105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.137432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.148098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-09cebadc-b788-402b-9b82-fc7dd913889c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:44.149156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 834/1652] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:44.149633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-09cebadc-b788-402b-9b82-fc7dd913889c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:44.153439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.157180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 819/1653] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:44.165959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc9d8-b405-4956-b45b-1c1630bc692a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.166196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cebadc-b788-402b-9b82-fc7dd913889c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.170741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.171309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.171576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.171860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] PATH_INFO: `/v3/projects/b83567d3ea354d299ec7df5826cb5409/users/5ca64be091614532aadb29a8f6795be2/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.178690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cebadc-b788-402b-9b82-fc7dd913889c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.184672 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.185300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.185607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.185874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.186530 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:44.186829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.188460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.192584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83567d3ea354d299ec7df5826cb5409, user_id=5ca64be091614532aadb29a8f6795be2, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.195358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.202238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 820/1654] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:58:44.207114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.213263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 835/1655] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:44 2022] PUT /identity/v3/projects/b83567d3ea354d299ec7df5826cb5409/users/5ca64be091614532aadb29a8f6795be2/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:44.217566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.217729 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8381e-93a7-462c-86fa-48fa975ad46d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.222724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:44.272281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:44.287506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.288115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.288425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.288695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.289320 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.291257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.292895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef07f3-5a1b-47f8-80bf-a94bc91e7c05 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.297742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.298367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.298642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.299038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.299537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.301201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.311493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 836/1656] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:44.316384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.319701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 821/1657] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:44 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:44.323659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.327043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f5f10-51b9-48af-9bef-28936d6253cd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.389078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c12262-09d9-43c7-a08a-197ad846a913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.389781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12262-09d9-43c7-a08a-197ad846a913 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.390060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12262-09d9-43c7-a08a-197ad846a913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.390334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c12262-09d9-43c7-a08a-197ad846a913 admin admin] PATH_INFO: `/v3/projects/b83567d3ea354d299ec7df5826cb5409/users/5ca64be091614532aadb29a8f6795be2/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.392275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12262-09d9-43c7-a08a-197ad846a913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83567d3ea354d299ec7df5826cb5409, user_id=5ca64be091614532aadb29a8f6795be2, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.394112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1cb02-39a5-4139-a159-91516a45ee28 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.394975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c12262-09d9-43c7-a08a-197ad846a913 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.398749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.399350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.399627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.399883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.400505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.402471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.406387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 837/1658] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:44 2022] PUT /identity/v3/projects/b83567d3ea354d299ec7df5826cb5409/users/5ca64be091614532aadb29a8f6795be2/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:44.418851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.419301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.419631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.429574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 822/1659] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:44 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:44.431714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.444477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354c71c-19c8-4661-807f-440257620109 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.451879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] MFA Rules not processed for user `5ca64be091614532aadb29a8f6795be2`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:44.453143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:44.522093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.522838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.523020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.523291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.523927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.525594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.536513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 823/1660] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:44.541001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.548862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 838/1661] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:44.552227 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8ae8c-310f-432a-b5d7-295e5bc74552 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.557907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.558679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.559009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.559393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.560329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.561203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.562241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.563025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:44.578761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 824/1662] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:44.579814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.590858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:44.594175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c222ff-a836-4ff5-8888-a939aa312a20 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.599663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf76831-aed8-4bd1-a0cf-ae68620b9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.600443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76831-aed8-4bd1-a0cf-ae68620b9034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.600960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76831-aed8-4bd1-a0cf-ae68620b9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.601324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf76831-aed8-4bd1-a0cf-ae68620b9034 admin admin] PATH_INFO: `/v3/projects/7c6584469c3042468b2b2f0965be61f6/users/d667805aed8f40edb8e2cb0d2d42abb3/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.621980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf76831-aed8-4bd1-a0cf-ae68620b9034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c6584469c3042468b2b2f0965be61f6, user_id=d667805aed8f40edb8e2cb0d2d42abb3, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.624677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf76831-aed8-4bd1-a0cf-ae68620b9034 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.643690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 825/1663] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:44 2022] PUT /identity/v3/projects/7c6584469c3042468b2b2f0965be61f6/users/d667805aed8f40edb8e2cb0d2d42abb3/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:44.654035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990a11-4c13-4bc9-a581-e0b6ddddfe5f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.654797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.655093 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.655375 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.688873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] MFA Rules not processed for user `d667805aed8f40edb8e2cb0d2d42abb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:44.690141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:44.710596 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:44.749225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b362c9-b9e9-48c4-b83f-805b9fd9e25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.749225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b362c9-b9e9-48c4-b83f-805b9fd9e25d service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.749225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b362c9-b9e9-48c4-b83f-805b9fd9e25d service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.749225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b362c9-b9e9-48c4-b83f-805b9fd9e25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.770432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 826/1664] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:44.781954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:44.783437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:44.795260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572628b-82a5-4e96-86f4-f4e5c43e4ece None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:44.799051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:44.799796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:44.800085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:44.800390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:44.808379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b362c9-b9e9-48c4-b83f-805b9fd9e25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.808678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:44.809900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b362c9-b9e9-48c4-b83f-805b9fd9e25d service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.810170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:44.820674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 827/1665] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:44.827249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 839/1666] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:44 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:44.990459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:45.076201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bd474-c3c5-4606-af5c-d8a8401afe15 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:45.082248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:45.083261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:45.083628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:45.083807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] PATH_INFO: `/v3/users/f99583bbf19b49e7875b05069cb08fc8` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:45.085114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99583bbf19b49e7875b05069cb08fc8)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:45.087237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:45.182859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99583bbf19b49e7875b05069cb08fc8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.196201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99583bbf19b49e7875b05069cb08fc8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.196938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99583bbf19b49e7875b05069cb08fc8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.204498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99583bbf19b49e7875b05069cb08fc8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.205088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99583bbf19b49e7875b05069cb08fc8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.226539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 828/1667] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:44 2022] DELETE /identity/v3/users/f99583bbf19b49e7875b05069cb08fc8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:45.231144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:45.231353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:45.231622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:45.251957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:45.253151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:45.322626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 840/1668] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:45.334249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:45.335952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:45.359359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:45.405048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522125b-d605-4285-91ce-dd19c52d1f3e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:45.408970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:45.409621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:45.409896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:45.410168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:45.420072 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:45.421514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:45.431798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 829/1669] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:45.724293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:45.725588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:45.743935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bafbf8-801e-420d-9374-81ce4f8c84d7 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:45.749351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:45.751169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:45.751514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:45.751866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] PATH_INFO: `/v3/projects/ccc4246fb7a34d30a70b3b3901d3af80` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:45.753089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccc4246fb7a34d30a70b3b3901d3af80)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:45.755491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:45.782860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:45.820377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc4246fb7a34d30a70b3b3901d3af80', 'request_id': 'req-8bbef917-3a4d-4c66-b838-3f3a75740aad'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.835778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc4246fb7a34d30a70b3b3901d3af80', 'request_id': 'req-8bbef917-3a4d-4c66-b838-3f3a75740aad'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.835778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc4246fb7a34d30a70b3b3901d3af80', 'request_id': 'req-8bbef917-3a4d-4c66-b838-3f3a75740aad'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.860508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] The token cache is being invalidate because project ccc4246fb7a34d30a70b3b3901d3af80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:45.860830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.861681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:45.863301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 841/1670] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:45 2022] DELETE /identity/v3/projects/ccc4246fb7a34d30a70b3b3901d3af80 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:45.868084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:45.880971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6069ef-3abb-459e-85a6-c400cd8141e7 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:45.949718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:45.950367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:45.950679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:45.950916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] PATH_INFO: `/v3/users/5ca64be091614532aadb29a8f6795be2` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:45.952041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca64be091614532aadb29a8f6795be2)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:45.953994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:46.009854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca64be091614532aadb29a8f6795be2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.022750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca64be091614532aadb29a8f6795be2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.023482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca64be091614532aadb29a8f6795be2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.031381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca64be091614532aadb29a8f6795be2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.032060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c2a6773b-43ce-457b-ab31-9eec8bab8536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca64be091614532aadb29a8f6795be2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.052391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 830/1671] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:45 2022] DELETE /identity/v3/users/5ca64be091614532aadb29a8f6795be2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:46.393566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:46.395180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:46.411893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbef917-3a4d-4c66-b838-3f3a75740aad admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:46.492136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:46.492839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:46.493183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:46.493499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] PATH_INFO: `/v3/projects/b83567d3ea354d299ec7df5826cb5409` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:46.494724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83567d3ea354d299ec7df5826cb5409)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:46.496777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:46.553706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83567d3ea354d299ec7df5826cb5409', 'request_id': 'req-ce293321-469c-4046-9666-b7a5627a2941'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.560529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83567d3ea354d299ec7df5826cb5409', 'request_id': 'req-ce293321-469c-4046-9666-b7a5627a2941'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.566310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83567d3ea354d299ec7df5826cb5409', 'request_id': 'req-ce293321-469c-4046-9666-b7a5627a2941'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.579968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] The token cache is being invalidate because project b83567d3ea354d299ec7df5826cb5409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:46.580270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.580890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ce293321-469c-4046-9666-b7a5627a2941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:46.582471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 842/1672] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:46 2022] DELETE /identity/v3/projects/b83567d3ea354d299ec7df5826cb5409 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:46.589934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a25612-3e8d-4136-9d52-f41f7a8c56ba None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:46.590430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a25612-3e8d-4136-9d52-f41f7a8c56ba None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:46.590515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a25612-3e8d-4136-9d52-f41f7a8c56ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:46.619228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-32a25612-3e8d-4136-9d52-f41f7a8c56ba None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:46.620748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-32a25612-3e8d-4136-9d52-f41f7a8c56ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:46.666235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:46.689605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 831/1673] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:46.697721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc7cb-40c3-49dd-aa9b-310db42a3b5f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:46.698095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc7cb-40c3-49dd-aa9b-310db42a3b5f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:46.698282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dc7cb-40c3-49dd-aa9b-310db42a3b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:46.718710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d52dc7cb-40c3-49dd-aa9b-310db42a3b5f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:46.719931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d52dc7cb-40c3-49dd-aa9b-310db42a3b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:46.729113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 843/1674] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:46.734126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a25612-3e8d-4136-9d52-f41f7a8c56ba None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:46.744747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a25612-3e8d-4136-9d52-f41f7a8c56ba None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:46.749678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:46.750279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:46.750559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:46.750830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:46.751510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:46.751809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:46.753441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:46.765806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 832/1675] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:58:46.770845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc7cb-40c3-49dd-aa9b-310db42a3b5f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:46.782738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dc7cb-40c3-49dd-aa9b-310db42a3b5f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:46.791399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:46.792235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:46.792586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:46.792958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:46.793997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:46.796861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:46.832855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 844/1676] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:46 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:46.838765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:46.850297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70fc51-7b1a-4aef-9c8b-7e25a3253820 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:46.916646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:46.917168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:46.917445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:46.917745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:46.918373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:46.920309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:46.945505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 833/1677] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:46 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:46.950311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:46.963956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc6a2b-fe15-4191-b254-5f511634f7b4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:46.970327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:46.970955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:46.971261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:46.972077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:46.973004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:46.975032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:46.977856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:46.992593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 845/1678] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:46.997484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.010879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdedecb-89a0-4870-9713-94adc70c11c0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.016979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc4c6d-1f3c-439e-ac53-c17dac479acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.017681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc4c6d-1f3c-439e-ac53-c17dac479acd admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.017961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc4c6d-1f3c-439e-ac53-c17dac479acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.018426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc4c6d-1f3c-439e-ac53-c17dac479acd admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.019081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc4c6d-1f3c-439e-ac53-c17dac479acd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.020728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc4c6d-1f3c-439e-ac53-c17dac479acd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.032539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 834/1679] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:47.041207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.053756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91e708-a867-471e-baac-44cb3aaeb141 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.060566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.061438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.061834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.062152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] PATH_INFO: `/v3/projects/f340a3f4c3ca4ba1a305cacad32992b0/users/b23c7b5d600d422f867fe72f23ac3273/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.079099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f340a3f4c3ca4ba1a305cacad32992b0, user_id=b23c7b5d600d422f867fe72f23ac3273, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.082794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.099262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 846/1680] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:47 2022] PUT /identity/v3/projects/f340a3f4c3ca4ba1a305cacad32992b0/users/b23c7b5d600d422f867fe72f23ac3273/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:47.110163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec52b4-22a4-480d-bacc-1233d23fa695 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.110632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec52b4-22a4-480d-bacc-1233d23fa695 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.110995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec52b4-22a4-480d-bacc-1233d23fa695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.149681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b3ec52b4-22a4-480d-bacc-1233d23fa695 None None] MFA Rules not processed for user `b23c7b5d600d422f867fe72f23ac3273`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:47.150901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b3ec52b4-22a4-480d-bacc-1233d23fa695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:47.234847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 835/1681] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:47.239993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.312788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d7bd-a4f3-4a39-a090-fb4f948ee49c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.318037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.318679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.318957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.319231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.319871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.321855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.359823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 847/1682] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:47 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:47.361344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec52b4-22a4-480d-bacc-1233d23fa695 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.373049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec52b4-22a4-480d-bacc-1233d23fa695 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.412009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:47.442022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.442653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.442930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.443196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.443836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.445814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.473722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 836/1683] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:47 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:47.479452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.491614 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13ad59-f871-4ed2-9bfb-8794576b3aac admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.498955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.499702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.500055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.500504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.501303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.503011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.518982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 848/1684] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:47.522486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.537051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca74294-3944-4294-80a2-f2503dfd29eb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.542327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.543006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.543272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.543601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] PATH_INFO: `/v3/projects/6dc19ea988354f52b6141fa90990ea24/users/12347b04bd934f61b05777cb88dd4af9/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.565597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc19ea988354f52b6141fa90990ea24, user_id=12347b04bd934f61b05777cb88dd4af9, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.568299 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.584171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 837/1685] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:47 2022] PUT /identity/v3/projects/6dc19ea988354f52b6141fa90990ea24/users/12347b04bd934f61b05777cb88dd4af9/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:47.588823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.601043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bb041-0ca6-499b-9998-82530fc0eda9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.681764 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d39135b-f277-4331-a0aa-d081a8f2c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.681968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39135b-f277-4331-a0aa-d081a8f2c185 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.682198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39135b-f277-4331-a0aa-d081a8f2c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.682475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39135b-f277-4331-a0aa-d081a8f2c185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.683127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39135b-f277-4331-a0aa-d081a8f2c185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.684775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d39135b-f277-4331-a0aa-d081a8f2c185 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.702284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.702745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 849/1686] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:47.712988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf8c7-9290-46de-b35b-a84bfa4cd74a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.718880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.719550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.719805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.720124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] PATH_INFO: `/v3/projects/6dc19ea988354f52b6141fa90990ea24/users/12347b04bd934f61b05777cb88dd4af9/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.722238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dc19ea988354f52b6141fa90990ea24, user_id=12347b04bd934f61b05777cb88dd4af9, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.725046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.737128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 838/1687] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:47 2022] PUT /identity/v3/projects/6dc19ea988354f52b6141fa90990ea24/users/12347b04bd934f61b05777cb88dd4af9/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:47.750341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8cf3-0371-447b-ae9c-2d0781bffbb2 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.750623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8cf3-0371-447b-ae9c-2d0781bffbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.750901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab8cf3-0371-447b-ae9c-2d0781bffbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.782762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1bab8cf3-0371-447b-ae9c-2d0781bffbb2 None None] MFA Rules not processed for user `12347b04bd934f61b05777cb88dd4af9`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:47.784038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1bab8cf3-0371-447b-ae9c-2d0781bffbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:47.822195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:47.871422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 850/1688] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:47.888391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:47.890380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:47.960612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd49124-f57f-47ab-861f-3a36532ecb9a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:47.965854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:47.966928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:47.967410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:47.967909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:47.984925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:47.987043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:47.999817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 839/1689] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:48.083668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8cf3-0371-447b-ae9c-2d0781bffbb2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:48.094489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab8cf3-0371-447b-ae9c-2d0781bffbb2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:48.098717 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd45fb2-2daa-4c20-8bdf-3e3ea52ddd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:48.099427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45fb2-2daa-4c20-8bdf-3e3ea52ddd57 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:48.099802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45fb2-2daa-4c20-8bdf-3e3ea52ddd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:48.100135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd45fb2-2daa-4c20-8bdf-3e3ea52ddd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:48.165720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd45fb2-2daa-4c20-8bdf-3e3ea52ddd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:48.167193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd45fb2-2daa-4c20-8bdf-3e3ea52ddd57 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:48.177072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 851/1690] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:55.297348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:55.361527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253cd073-7bb9-4a09-8c94-d5d85349fa7d service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:55.366253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:55.366899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:55.367179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:55.367450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] PATH_INFO: `/v3/users/b23c7b5d600d422f867fe72f23ac3273` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:55.368589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23c7b5d600d422f867fe72f23ac3273)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:55.370571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:55.412134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:55.424281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23c7b5d600d422f867fe72f23ac3273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:55.438006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23c7b5d600d422f867fe72f23ac3273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:55.438742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23c7b5d600d422f867fe72f23ac3273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:55.446538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23c7b5d600d422f867fe72f23ac3273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:55.447266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23c7b5d600d422f867fe72f23ac3273'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:55.464618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 840/1691] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:55 2022] DELETE /identity/v3/users/b23c7b5d600d422f867fe72f23ac3273 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:55.476858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:55.477723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:55.477860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:55.499664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:55.501020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:55.565783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 852/1692] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:55.578042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:55.579660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:55.664792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa75b-f0ac-4361-ac5f-b372dd38255f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:55.670619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:55.671662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:55.672154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:55.672621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:55.686896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:55.690003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:55.708544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 841/1693] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:56.028922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:56.030608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:56.045549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4144064-3c80-4b33-9d18-0c0adabe8c6f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:56.052225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:56.053357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.054184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.054670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] PATH_INFO: `/v3/projects/f340a3f4c3ca4ba1a305cacad32992b0` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.056978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f340a3f4c3ca4ba1a305cacad32992b0)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:56.061533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:56.126766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f340a3f4c3ca4ba1a305cacad32992b0', 'request_id': 'req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.134551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f340a3f4c3ca4ba1a305cacad32992b0', 'request_id': 'req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.147668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f340a3f4c3ca4ba1a305cacad32992b0', 'request_id': 'req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.150041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:56.164669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] The token cache is being invalidate because project f340a3f4c3ca4ba1a305cacad32992b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:56.164961 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.165713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.167493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 853/1694] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:56 2022] DELETE /identity/v3/projects/f340a3f4c3ca4ba1a305cacad32992b0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:56.171882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:56.182538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca31dd-e958-4c8d-b00d-04c403d02ec5 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:56.248761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:56.249719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.249996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.250264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] PATH_INFO: `/v3/users/12347b04bd934f61b05777cb88dd4af9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.251663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12347b04bd934f61b05777cb88dd4af9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:56.253780 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:56.306404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12347b04bd934f61b05777cb88dd4af9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.313947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:56.320961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12347b04bd934f61b05777cb88dd4af9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.322053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12347b04bd934f61b05777cb88dd4af9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.330083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12347b04bd934f61b05777cb88dd4af9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.330824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12347b04bd934f61b05777cb88dd4af9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.345405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 842/1695] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:56 2022] DELETE /identity/v3/users/12347b04bd934f61b05777cb88dd4af9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:56.620634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:56.622153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:56.625064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:56.626745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:56.636566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f16ee6-5837-4440-9e2c-a6e51e1a71a2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:56.697984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:56.699161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.699449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.699723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] PATH_INFO: `/v3/users/d667805aed8f40edb8e2cb0d2d42abb3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.700294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b483d-f491-4eb4-985c-1ad602361ed8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:56.700883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d667805aed8f40edb8e2cb0d2d42abb3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:56.703001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:56.705395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:56.706033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.706310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.706580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] PATH_INFO: `/v3/projects/6dc19ea988354f52b6141fa90990ea24` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.707737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dc19ea988354f52b6141fa90990ea24)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:56.709618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:56.762869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd667805aed8f40edb8e2cb0d2d42abb3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.763524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd667805aed8f40edb8e2cb0d2d42abb3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.764147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd667805aed8f40edb8e2cb0d2d42abb3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.768923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dc19ea988354f52b6141fa90990ea24', 'request_id': 'req-49f77cff-760d-4c6b-af6d-751a41f47b34'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.778262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dc19ea988354f52b6141fa90990ea24', 'request_id': 'req-49f77cff-760d-4c6b-af6d-751a41f47b34'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.779367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd667805aed8f40edb8e2cb0d2d42abb3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.788304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e36f9c6b-4eaf-40be-a542-beb23147f1e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd667805aed8f40edb8e2cb0d2d42abb3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.788753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dc19ea988354f52b6141fa90990ea24', 'request_id': 'req-49f77cff-760d-4c6b-af6d-751a41f47b34'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.807395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 854/1696] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:56 2022] DELETE /identity/v3/users/d667805aed8f40edb8e2cb0d2d42abb3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:56.807863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] The token cache is being invalidate because project 6dc19ea988354f52b6141fa90990ea24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:56.808231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.809831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-49f77cff-760d-4c6b-af6d-751a41f47b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:56.811777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 843/1697] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:56 2022] DELETE /identity/v3/projects/6dc19ea988354f52b6141fa90990ea24 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:56.812805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e45f0-effe-44c5-9a50-3b0f264a8a5e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.813802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e45f0-effe-44c5-9a50-3b0f264a8a5e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.814849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e45f0-effe-44c5-9a50-3b0f264a8a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.817349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.818242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.818763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.848838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8d7e45f0-effe-44c5-9a50-3b0f264a8a5e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:56.850141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:56.850330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8d7e45f0-effe-44c5-9a50-3b0f264a8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:56.851757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:56.920478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 855/1698] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:56.922395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 844/1699] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:56.931025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1501c-7d56-4a22-aecf-c14921493323 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.931370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1501c-7d56-4a22-aecf-c14921493323 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.931728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1501c-7d56-4a22-aecf-c14921493323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.933798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:56.935262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:56.941649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:56.954711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-31e1501c-7d56-4a22-aecf-c14921493323 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:56.962780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-31e1501c-7d56-4a22-aecf-c14921493323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:56.971940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 856/1700] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:56.976357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1501c-7d56-4a22-aecf-c14921493323 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:56.982086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:56.986175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1501c-7d56-4a22-aecf-c14921493323 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:56.992041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:56.992779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:56.993078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:56.993591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:56.994242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:56.994545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:56.996355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.003190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a1242-fcec-4d0e-8771-5423c446d423 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.007218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.007868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.008143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.008415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.013307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 857/1701] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:58:57.014290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.018373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.019809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.024494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bd4ba-5225-4f9d-8906-c28275c73c4a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.029150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.029556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 845/1702] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:57.029871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.030143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.030513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.031042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.032955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.065889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 858/1703] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:57.067450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.079884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599f5a4-b4d9-43f6-85f8-918fe2fb7d64 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.143881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.144467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.144737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.144999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.145698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.147713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.170301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 846/1704] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:57.174545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.197873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db177637-76b0-40a9-a4eb-d96facbd6aab admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.203673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.204410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.204619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.204924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.205611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.207226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.218803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 859/1705] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:57.223201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.241283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08881b16-9be5-47f9-a2a2-a9f868297406 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.251059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.252524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.253049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.253649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.255064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.257449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.275494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 847/1706] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:57.282670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.301328 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ed80-983c-404b-8404-2bbdb3a04a1f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.309742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc15ab8-c9a4-4559-b146-a33b21a4b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.310892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc15ab8-c9a4-4559-b146-a33b21a4b6b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.311401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc15ab8-c9a4-4559-b146-a33b21a4b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.311903 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc15ab8-c9a4-4559-b146-a33b21a4b6b5 admin admin] PATH_INFO: `/v3/projects/2ac2fa7201284e169b1117f075f70bb1/users/f5e1efded46b4b62b3b41e8f2c5dee47/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.330888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc15ab8-c9a4-4559-b146-a33b21a4b6b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac2fa7201284e169b1117f075f70bb1, user_id=f5e1efded46b4b62b3b41e8f2c5dee47, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.333733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc15ab8-c9a4-4559-b146-a33b21a4b6b5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.346561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.347712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 860/1707] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:57 2022] PUT /identity/v3/projects/2ac2fa7201284e169b1117f075f70bb1/users/f5e1efded46b4b62b3b41e8f2c5dee47/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:57.348322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:57.360183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04da26f-956e-4b75-a1b4-a579758adab0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.360474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04da26f-956e-4b75-a1b4-a579758adab0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.360748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04da26f-956e-4b75-a1b4-a579758adab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.370364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80559e-d602-42ac-81f5-6357dcf839a8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.391429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c04da26f-956e-4b75-a1b4-a579758adab0 None None] MFA Rules not processed for user `f5e1efded46b4b62b3b41e8f2c5dee47`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:57.392658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c04da26f-956e-4b75-a1b4-a579758adab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:57.432028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.432686 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.432956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.433222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] PATH_INFO: `/v3/projects/7c6584469c3042468b2b2f0965be61f6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.434429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c6584469c3042468b2b2f0965be61f6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.436366 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.462233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 861/1708] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:57.466643 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04da26f-956e-4b75-a1b4-a579758adab0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.474099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:57.480529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04da26f-956e-4b75-a1b4-a579758adab0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.495138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c6584469c3042468b2b2f0965be61f6', 'request_id': 'req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:57.501579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c6584469c3042468b2b2f0965be61f6', 'request_id': 'req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:57.508161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c6584469c3042468b2b2f0965be61f6', 'request_id': 'req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:57.521927 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] The token cache is being invalidate because project 7c6584469c3042468b2b2f0965be61f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:57.522240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:57.522903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5ba3ae5f-ce1e-40e2-9f7d-e2a01d7d8dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:57.524431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 848/1709] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:57 2022] DELETE /identity/v3/projects/7c6584469c3042468b2b2f0965be61f6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:57.529347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c67ab-45b8-4d9f-a668-a3decd48c420 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.529653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c67ab-45b8-4d9f-a668-a3decd48c420 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.529919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c67ab-45b8-4d9f-a668-a3decd48c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.542048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.542652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.542931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.543218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.543817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.545769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.549868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f45c67ab-45b8-4d9f-a668-a3decd48c420 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:57.551074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f45c67ab-45b8-4d9f-a668-a3decd48c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:57.559942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 849/1710] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:57.568114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5143-773a-4825-97de-ed4cb09e9f0e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.568399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5143-773a-4825-97de-ed4cb09e9f0e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.568676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b5143-773a-4825-97de-ed4cb09e9f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.578806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 862/1711] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:57.580142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.581831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:57.589647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d76b5143-773a-4825-97de-ed4cb09e9f0e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:57.590876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d76b5143-773a-4825-97de-ed4cb09e9f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:57.593202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:57.657315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020663b7-6822-41ec-a0a7-ed09b420d5c9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.659530 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 850/1712] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:57.662247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.663259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.663559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.663824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.663954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5143-773a-4825-97de-ed4cb09e9f0e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.664446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.666418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.672787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b5143-773a-4825-97de-ed4cb09e9f0e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.677645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.678162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.678504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.678780 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.679433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:58:57.679730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.681398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.693907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 863/1713] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:57.695072 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 851/1714] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 19:58:57.697993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.699238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.708229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da42f4e-ae49-4eff-b0b6-47f49f54101e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.708760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf85ec0-75d3-4119-8e5d-23ed4ff576b4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.713514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.713646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.714053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.714146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.714337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.714466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.714622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.714731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.715237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.715340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.716860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.717229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.730659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 864/1715] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:57.731959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.742074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32acc8-5eb7-4202-9cd6-ec7bd27899fa admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.746597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.747242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.747525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.747786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] PATH_INFO: `/v3/projects/c04b1a044bc64878b3f4664d93919d48/users/9c4c4d3a1aa742c0af4998f04d82c7ef/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.751338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 852/1716] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:57.752083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.763318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04b1a044bc64878b3f4664d93919d48, user_id=9c4c4d3a1aa742c0af4998f04d82c7ef, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.766130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.786674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 865/1717] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:57 2022] PUT /identity/v3/projects/c04b1a044bc64878b3f4664d93919d48/users/9c4c4d3a1aa742c0af4998f04d82c7ef/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:57.790765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.825248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37dd6e-6065-4cb0-b6be-82cf047d3e39 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.850099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:57.856400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8bf3f-34f3-4eb2-b42a-b44dc4677906 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.861331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.862038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.862329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.862621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.863288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.864897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.875073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 866/1718] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:57.879682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.889979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ce369-8221-45c8-8dc8-d4036e7bec25 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.890687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.891305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.891582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.891861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.892488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.894490 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.894593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9317e5b-53a6-4bf8-97be-4aef143e1929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:57.895185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317e5b-53a6-4bf8-97be-4aef143e1929 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.895466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317e5b-53a6-4bf8-97be-4aef143e1929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.895740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317e5b-53a6-4bf8-97be-4aef143e1929 admin admin] PATH_INFO: `/v3/projects/c04b1a044bc64878b3f4664d93919d48/users/9c4c4d3a1aa742c0af4998f04d82c7ef/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.898269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9317e5b-53a6-4bf8-97be-4aef143e1929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04b1a044bc64878b3f4664d93919d48, user_id=9c4c4d3a1aa742c0af4998f04d82c7ef, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:57.905931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9317e5b-53a6-4bf8-97be-4aef143e1929 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:57.918883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 867/1719] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:57 2022] PUT /identity/v3/projects/c04b1a044bc64878b3f4664d93919d48/users/9c4c4d3a1aa742c0af4998f04d82c7ef/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:57.927393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 853/1720] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:57.929584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:57.929871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:57.930143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:57.931558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:57.941592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec354f83-9077-4b39-af72-dd7aeca2856b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:57.959226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] MFA Rules not processed for user `9c4c4d3a1aa742c0af4998f04d82c7ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:57.960598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.002185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.002838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.003120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.003388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.004376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.006012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.006848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:58.018796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 854/1721] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:58.023168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.036639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3800b7e-86fc-4003-831f-bf8f5e5a0a07 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.042422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.043033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.043309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.045422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.045422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.046294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.050241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 868/1722] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:57 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:58.059297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 855/1723] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:58.062855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.063574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.064525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.073953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366f348-b549-42d6-9e59-a6305c0ea8ed admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.079478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babb037-cbd4-4aaa-92a6-b3c4f4d6772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.080139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb037-cbd4-4aaa-92a6-b3c4f4d6772a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.080415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb037-cbd4-4aaa-92a6-b3c4f4d6772a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.080684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb037-cbd4-4aaa-92a6-b3c4f4d6772a admin admin] PATH_INFO: `/v3/projects/afa03d338c8c49629c3f4bb3ef599776/users/8e2971653bf445d7bf166a2be0d50ac2/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.096191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babb037-cbd4-4aaa-92a6-b3c4f4d6772a admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa03d338c8c49629c3f4bb3ef599776, user_id=8e2971653bf445d7bf166a2be0d50ac2, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.098875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babb037-cbd4-4aaa-92a6-b3c4f4d6772a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.117398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 856/1724] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:58 2022] PUT /identity/v3/projects/afa03d338c8c49629c3f4bb3ef599776/users/8e2971653bf445d7bf166a2be0d50ac2/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:58.128042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93891-f613-4a03-8b66-3522dabbe188 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.128326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93891-f613-4a03-8b66-3522dabbe188 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.128600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93891-f613-4a03-8b66-3522dabbe188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.140824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d6cb-ac85-4b3e-8bee-d26701faef0c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.159183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b6c93891-f613-4a03-8b66-3522dabbe188 None None] MFA Rules not processed for user `8e2971653bf445d7bf166a2be0d50ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:58.161279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b6c93891-f613-4a03-8b66-3522dabbe188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.202636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.203275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.203549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.203826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.232228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 857/1725] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:58.236935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93891-f613-4a03-8b66-3522dabbe188 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.240892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:58.269314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.270963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.281956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 869/1726] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:58.302866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93891-f613-4a03-8b66-3522dabbe188 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.308777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.309433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.309740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.309979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.310648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.312521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.354571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 858/1727] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:58 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:58.359040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.370653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585dfde-dcdf-4a8b-a309-3a89de7fdb8d service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.419217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:58.441663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.465083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.465695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.465860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.466153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.467382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.469668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.496112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 870/1728] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:58 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:58:58.500311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.511820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e237c-ef59-450d-a8ff-a24a56f9fc3c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.515840 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524d688-98f7-4ed4-9c96-3b5d5be8f0c9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.517268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.517838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.518145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.518435 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.519205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.521028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.521136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.521736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.522018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.522358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] PATH_INFO: `/v3/users/f5e1efded46b4b62b3b41e8f2c5dee47` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.523504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e1efded46b4b62b3b41e8f2c5dee47)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.525685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.537425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 871/1729] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:58.538874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.549198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7b26-8425-4e15-8c07-4577746507c4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.554255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.554882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.555159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.555496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.556312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.558023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.571259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 872/1730] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:58:58.576393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.593026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e1efded46b4b62b3b41e8f2c5dee47'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:58.604332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ac39-55c3-4f9f-a133-853752c0f2a9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.610189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1e526-7d96-403d-b942-b7938f7e99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.610327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e1efded46b4b62b3b41e8f2c5dee47'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:58.611006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1e526-7d96-403d-b942-b7938f7e99c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.611231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e1efded46b4b62b3b41e8f2c5dee47'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:58.611329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1e526-7d96-403d-b942-b7938f7e99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.611672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1e526-7d96-403d-b942-b7938f7e99c5 admin admin] PATH_INFO: `/v3/projects/d63234a9746144a5a1990a27398e516d/users/24a0f20bebb04cb5a3a15c316fe0ef3e/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.622745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e1efded46b4b62b3b41e8f2c5dee47'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:58.623717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-451c8ccd-e64f-4f79-a363-93b1d15ec8a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e1efded46b4b62b3b41e8f2c5dee47'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:58.628174 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1e526-7d96-403d-b942-b7938f7e99c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63234a9746144a5a1990a27398e516d, user_id=24a0f20bebb04cb5a3a15c316fe0ef3e, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.631858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1e526-7d96-403d-b942-b7938f7e99c5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.640636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 859/1731] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:58 2022] DELETE /identity/v3/users/f5e1efded46b4b62b3b41e8f2c5dee47 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:58.645230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.645555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.645829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.646999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 873/1732] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:58 2022] PUT /identity/v3/projects/d63234a9746144a5a1990a27398e516d/users/24a0f20bebb04cb5a3a15c316fe0ef3e/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:58.659715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.660424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:58.660987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.661271 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.667516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:58.669987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.701302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] MFA Rules not processed for user `24a0f20bebb04cb5a3a15c316fe0ef3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:58.702660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.785595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 860/1733] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:58:58.794997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.796480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.811101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 874/1734] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:58.815727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.817085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:58.830343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2af9a-5a55-460a-8cc7-7412c1f349eb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.836252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.836860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.837296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.837566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.838927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.841065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.859630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d9cfd-e20b-49f2-b2a6-7c094e3370c7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.863976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.864591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.864867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.865131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.868222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 875/1735] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:58:58 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:58.872530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.875435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.876894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.887593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 861/1736] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:58:58.922238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:58.937672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce41cdd-1f08-4e8e-9380-6b332757d4a1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.942859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.943514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.943791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.944156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.944796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.946766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:58.969444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 876/1737] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:58:58 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:58:58.973428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:58.983987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ccf18-665c-4dc6-bc7d-1f3d406a3a4d service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:58.989634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:58.990424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:58.990720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:58.991085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:58.991886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:58.993653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.009107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 862/1738] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:59.010538 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:59.020708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e46ffd-348e-4799-b2fa-791847cded3b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:59.026052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:59.026733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:59.027005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:59.027270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] PATH_INFO: `/v3/projects/36f0263458714a48aa45625d5f9724f9/users/0df5a87e7a934bef9a168548eb6a19b0/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:59.046368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f0263458714a48aa45625d5f9724f9, user_id=0df5a87e7a934bef9a168548eb6a19b0, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:59.049324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.067384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 877/1739] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:59 2022] PUT /identity/v3/projects/36f0263458714a48aa45625d5f9724f9/users/0df5a87e7a934bef9a168548eb6a19b0/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:59.072284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:59.083238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943b473-8219-440d-bde0-76e62521bd82 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:59.144420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:59.145427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:59.145717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:59.145986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:59.146641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:59.148367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.160053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 863/1740] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:58:59.167547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:59.180475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340e877-c8b0-4dfe-acc8-c468d21dee40 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:59.187117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c4623-e764-44cf-8325-4e11d90f8e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:59.187933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4623-e764-44cf-8325-4e11d90f8e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:59.188464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4623-e764-44cf-8325-4e11d90f8e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:59.190243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c4623-e764-44cf-8325-4e11d90f8e14 admin admin] PATH_INFO: `/v3/projects/36f0263458714a48aa45625d5f9724f9/users/0df5a87e7a934bef9a168548eb6a19b0/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:59.193529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4623-e764-44cf-8325-4e11d90f8e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f0263458714a48aa45625d5f9724f9, user_id=0df5a87e7a934bef9a168548eb6a19b0, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:59.196323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c4623-e764-44cf-8325-4e11d90f8e14 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.202297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:59.205819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:59.210810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 878/1741] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:58:59 2022] PUT /identity/v3/projects/36f0263458714a48aa45625d5f9724f9/users/0df5a87e7a934bef9a168548eb6a19b0/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:58:59.221371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:59.221835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:59.222117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:59.228496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d988c8-c800-4598-9532-d88d2ec0194b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:59.258025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] MFA Rules not processed for user `0df5a87e7a934bef9a168548eb6a19b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:58:59.259284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:59.295931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:59.322014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:59.322785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:59.323065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:59.323331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] PATH_INFO: `/v3/projects/2ac2fa7201284e169b1117f075f70bb1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:59.324656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac2fa7201284e169b1117f075f70bb1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:59.326606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.343344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 879/1742] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:58:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:58:59.358759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:59.361032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:59.390515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac2fa7201284e169b1117f075f70bb1', 'request_id': 'req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.397267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac2fa7201284e169b1117f075f70bb1', 'request_id': 'req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.404058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac2fa7201284e169b1117f075f70bb1', 'request_id': 'req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.418180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] The token cache is being invalidate because project 2ac2fa7201284e169b1117f075f70bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:58:59.418462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.419118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.420888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 864/1743] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:59 2022] DELETE /identity/v3/projects/2ac2fa7201284e169b1117f075f70bb1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:59.424665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5545c3-0e11-4321-91d7-8f5d297e2dea None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:59.424811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:59.426217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:59.466866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:59.478689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:59.479826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:59.479826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:59.479826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:59.481837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:58:59.494206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7b8de-b52a-4950-a127-b00fa4cfa9ff admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:58:59.498969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:58:59.499534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:58:59.499807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:58:59.500074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] PATH_INFO: `/v3/users/9c4c4d3a1aa742c0af4998f04d82c7ef` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:58:59.501214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4c4d3a1aa742c0af4998f04d82c7ef)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:59.505132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.545654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:58:59.547158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:58:59.558470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 880/1744] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:58:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:58:59.576205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4c4d3a1aa742c0af4998f04d82c7ef'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.592260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4c4d3a1aa742c0af4998f04d82c7ef'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.593004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4c4d3a1aa742c0af4998f04d82c7ef'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.595458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:58:59.604173 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4c4d3a1aa742c0af4998f04d82c7ef'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.606129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6c17cb91-2861-4b85-a7fe-2575a05cd5b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4c4d3a1aa742c0af4998f04d82c7ef'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:58:59.622723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 865/1745] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:58:59 2022] DELETE /identity/v3/users/9c4c4d3a1aa742c0af4998f04d82c7ef => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:58:59.959631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:58:59.979403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16e76-2da8-47b2-bf7b-72e4cf204a5c service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.050957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.051672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.051951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.052279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] PATH_INFO: `/v3/projects/c04b1a044bc64878b3f4664d93919d48` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.053584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04b1a044bc64878b3f4664d93919d48)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.055638 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.103995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04b1a044bc64878b3f4664d93919d48', 'request_id': 'req-be6e00ee-9632-44c2-a6d1-454efbc959bc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:00.110775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04b1a044bc64878b3f4664d93919d48', 'request_id': 'req-be6e00ee-9632-44c2-a6d1-454efbc959bc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:00.118192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04b1a044bc64878b3f4664d93919d48', 'request_id': 'req-be6e00ee-9632-44c2-a6d1-454efbc959bc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:00.132550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] The token cache is being invalidate because project c04b1a044bc64878b3f4664d93919d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:00.132840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:00.133553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-be6e00ee-9632-44c2-a6d1-454efbc959bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:00.135133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 881/1746] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:58:59 2022] DELETE /identity/v3/projects/c04b1a044bc64878b3f4664d93919d48 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:00.141109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245144b-1661-4432-aa33-9b12edf95944 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.141410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245144b-1661-4432-aa33-9b12edf95944 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.141683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a245144b-1661-4432-aa33-9b12edf95944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.164140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a245144b-1661-4432-aa33-9b12edf95944 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:00.165465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a245144b-1661-4432-aa33-9b12edf95944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:00.249453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 866/1747] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:00.258052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f568-cf8b-4c16-b76f-2302c518c805 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.258434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f568-cf8b-4c16-b76f-2302c518c805 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.258704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5f568-cf8b-4c16-b76f-2302c518c805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.279400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7cc5f568-cf8b-4c16-b76f-2302c518c805 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:00.280620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7cc5f568-cf8b-4c16-b76f-2302c518c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:00.288865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 882/1748] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:00.293580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245144b-1661-4432-aa33-9b12edf95944 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.303655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a245144b-1661-4432-aa33-9b12edf95944 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.308791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.309414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.309703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.309967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.310603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:00.310900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.312554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.325079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 867/1749] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:00.329536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f568-cf8b-4c16-b76f-2302c518c805 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.339365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5f568-cf8b-4c16-b76f-2302c518c805 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.346042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.346647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.346922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.347188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.347816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.349778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.375401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:00.384772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 883/1750] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:00 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:00.389291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.399571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287541dc-bd13-406a-a89b-da4640ae9146 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.459889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.460509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.460787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.461057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.461720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.463649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.485928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 868/1751] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:00 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:00.490188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.501668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2355959-1710-478c-90bc-c3a49103da4e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.507888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.508818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.509371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.510039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.510929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.513332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.528425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 884/1752] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:00.529962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.540291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d49bb-f98c-4c12-80d8-cf19051deab2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.545650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557f51a3-9f14-4dc6-8334-c5716fdfc8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.546263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f51a3-9f14-4dc6-8334-c5716fdfc8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.546536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f51a3-9f14-4dc6-8334-c5716fdfc8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.546799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557f51a3-9f14-4dc6-8334-c5716fdfc8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.547436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f51a3-9f14-4dc6-8334-c5716fdfc8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.549027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557f51a3-9f14-4dc6-8334-c5716fdfc8d1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.561413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 869/1753] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:00.565253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.577040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d94958-e4c5-4a04-9e21-622718d437c0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.581980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.582641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.582935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.583185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] PATH_INFO: `/v3/projects/0e910ec819d348d1b3f31239dca0d865/users/fc503df7f7164c59b2322d80cbbd57bb/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.599714 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e910ec819d348d1b3f31239dca0d865, user_id=fc503df7f7164c59b2322d80cbbd57bb, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.602567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.616486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 885/1754] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:00 2022] PUT /identity/v3/projects/0e910ec819d348d1b3f31239dca0d865/users/fc503df7f7164c59b2322d80cbbd57bb/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:00.632729 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2b4cf-e002-447d-8e2d-e43f8b113146 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.633017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2b4cf-e002-447d-8e2d-e43f8b113146 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.633285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2b4cf-e002-447d-8e2d-e43f8b113146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.662801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e0f2b4cf-e002-447d-8e2d-e43f8b113146 None None] MFA Rules not processed for user `fc503df7f7164c59b2322d80cbbd57bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:00.664183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e0f2b4cf-e002-447d-8e2d-e43f8b113146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:00.708204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:00.735825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 870/1755] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:00 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:00.742146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.814664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e245220-1341-456b-a08c-258b9161784a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.819277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.819891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.820173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.820453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.821092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.823084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.855103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 886/1756] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:00 2022] POST /identity/v3/projects => generated 409 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:00.860340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2b4cf-e002-447d-8e2d-e43f8b113146 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.872077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2b4cf-e002-447d-8e2d-e43f8b113146 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.936451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.937094 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.937371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.937691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.938332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.940252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:00.966509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 871/1757] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:00 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:00.968045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:00.979426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b5e6e-966c-4a7f-80c5-951539d328a8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:00.986075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:00.986773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:00.987044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:00.987307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:00.987985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:00.989682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:01.001918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 887/1758] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:01.007495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:01.018823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec178d8-99f2-43bc-a717-ebee851a9f95 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:01.025008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:01.025605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:01.025885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:01.026176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] PATH_INFO: `/v3/projects/49119f20c482438b973a25362bf8ed39/users/04ed846543ec4410b6a721c1d0816f12/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:01.046352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49119f20c482438b973a25362bf8ed39, user_id=04ed846543ec4410b6a721c1d0816f12, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:01.048999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:01.065001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 872/1759] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:01 2022] PUT /identity/v3/projects/49119f20c482438b973a25362bf8ed39/users/04ed846543ec4410b6a721c1d0816f12/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:01.069609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:01.082179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f69d8-9b56-4840-97d2-a1ecda09faf9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:01.148147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:01.148871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:01.149413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:01.149678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:01.150056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:01.150431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:01.152074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:01.152346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:01.163097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 888/1760] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:01.168510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:01.179464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b0592-19de-45f7-8821-1775c30cfe75 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:01.184355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ab420-5ac1-4630-9207-8f78f3b292d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:01.185018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab420-5ac1-4630-9207-8f78f3b292d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:01.185294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab420-5ac1-4630-9207-8f78f3b292d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:01.185604 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ab420-5ac1-4630-9207-8f78f3b292d9 admin admin] PATH_INFO: `/v3/projects/49119f20c482438b973a25362bf8ed39/users/04ed846543ec4410b6a721c1d0816f12/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:01.187566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ab420-5ac1-4630-9207-8f78f3b292d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49119f20c482438b973a25362bf8ed39, user_id=04ed846543ec4410b6a721c1d0816f12, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:01.190294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ab420-5ac1-4630-9207-8f78f3b292d9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:01.202447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 889/1761] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:01 2022] PUT /identity/v3/projects/49119f20c482438b973a25362bf8ed39/users/04ed846543ec4410b6a721c1d0816f12/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:01.213725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:01.214121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:01.214523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:01.236738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a22d9-879b-4de0-9ea3-bd50825e74f8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:01.252233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] MFA Rules not processed for user `04ed846543ec4410b6a721c1d0816f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:01.254696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:01.267749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:01.302233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:01.302947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:01.303290 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:01.303627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:01.306172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:01.323303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:01.344055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 890/1762] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:01 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:59:01.357149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:01.359203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:01.379385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206cba3-cd6c-45e9-b08b-e3c3ec289c31 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:01.383215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:01.383819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:01.384091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:01.384362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:01.386746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:01.388191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:01.394046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:01.395507 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:01.397328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 873/1763] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:59:01.405519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 891/1764] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:01 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:01.664106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:01.675798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370afc7c-3e74-4a96-9292-317a0d3df888 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:01.680372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:01.681081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:01.681726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:01.682014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:01.750952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:01.752598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:01.771200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 874/1765] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:02.031450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:02.047946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdfb96-237f-4e6b-8c6e-be7ff78baf19 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:02.060853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:02.062672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:02.064054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:02.064782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:02.070962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:02.167093 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:02.168581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:02.178827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 892/1766] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:06.138696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:06.140364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:06.242695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:06.244561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:06.252435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6bbfb-f1d9-4e4c-b2d9-bad7a962c154 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:06.259074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:06.259628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:06.259904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:06.260181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] PATH_INFO: `/v3/users/9de0af2a66044689905462fa08db17b8` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:06.261941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de0af2a66044689905462fa08db17b8)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:06.262816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b226cd-2670-4c48-a306-633e2fff5ed2 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:06.263898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:06.269253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:06.271035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:06.271035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:06.271035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] PATH_INFO: `/v3/users/8e2971653bf445d7bf166a2be0d50ac2` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:06.272916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2971653bf445d7bf166a2be0d50ac2)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:06.274612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:06.329315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de0af2a66044689905462fa08db17b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.329787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2971653bf445d7bf166a2be0d50ac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.330622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2971653bf445d7bf166a2be0d50ac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.331243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2971653bf445d7bf166a2be0d50ac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.336778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:06.343218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de0af2a66044689905462fa08db17b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.343995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de0af2a66044689905462fa08db17b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.344341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2971653bf445d7bf166a2be0d50ac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.351685 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de0af2a66044689905462fa08db17b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.352493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d1c888ab-0a45-4712-b349-b8a732950ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de0af2a66044689905462fa08db17b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.367186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 875/1767] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:06 2022] DELETE /identity/v3/users/9de0af2a66044689905462fa08db17b8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:06.367377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-c4add9dd-e916-4c41-9268-591bac8f24f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2971653bf445d7bf166a2be0d50ac2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:06.372677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:06.373240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:06.373644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:06.378091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:06.383906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 893/1768] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:06 2022] DELETE /identity/v3/users/8e2971653bf445d7bf166a2be0d50ac2 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:06.389709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:06.390157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:06.390606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:06.395978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:06.397215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:06.411703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:06.413479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:06.462350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 876/1769] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:59:06.472700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:06.474725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:06.486700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 894/1770] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:06.497786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:06.499216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:06.534214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4164a-4939-43f3-99ea-a8e2aa51238c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:06.538026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:06.538724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:06.538995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:06.539262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:06.548748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:06.550223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:06.561351 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 877/1771] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:06.562459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05aeb7-ff56-4538-99d5-432807fdcc53 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:06.566773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:06.567434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:06.567681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:06.567954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:06.581891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:06.583351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:06.596068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 895/1772] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 19:59:07.055563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.057160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.070767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6abd303-e41f-419b-ad5b-50c155a844e7 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.077602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.078436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.079260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.079260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] PATH_INFO: `/v3/projects/c3103d632e6a4f9395dec9f9e472e87f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.080703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3103d632e6a4f9395dec9f9e472e87f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.084044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.119344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.121021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.140755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c53a5-41aa-40a8-bd1e-83b2630f1a67 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.160708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3103d632e6a4f9395dec9f9e472e87f', 'request_id': 'req-36f8b65a-5e65-40e4-a528-44bf132eaf4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.172932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3103d632e6a4f9395dec9f9e472e87f', 'request_id': 'req-36f8b65a-5e65-40e4-a528-44bf132eaf4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.181879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3103d632e6a4f9395dec9f9e472e87f', 'request_id': 'req-36f8b65a-5e65-40e4-a528-44bf132eaf4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.195667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:07.201235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] The token cache is being invalidate because project c3103d632e6a4f9395dec9f9e472e87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:07.201666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.202556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-36f8b65a-5e65-40e4-a528-44bf132eaf4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.204907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 878/1773] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:07 2022] DELETE /identity/v3/projects/c3103d632e6a4f9395dec9f9e472e87f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:07.212238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.212525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.212803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.214191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.215068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.215296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.215637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] PATH_INFO: `/v3/projects/afa03d338c8c49629c3f4bb3ef599776` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.216873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa03d338c8c49629c3f4bb3ef599776)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.218909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.234017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:07.235500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.248036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 879/1774] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:59:07.248036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.251239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.263584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd7c18-8946-4eac-98e7-4d551238a367 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.270537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:07.275146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa03d338c8c49629c3f4bb3ef599776', 'request_id': 'req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.283048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa03d338c8c49629c3f4bb3ef599776', 'request_id': 'req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.288813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa03d338c8c49629c3f4bb3ef599776', 'request_id': 'req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.303997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] The token cache is being invalidate because project afa03d338c8c49629c3f4bb3ef599776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:07.304438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.305195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-edba676d-dd8b-49dd-88ff-7fc73fbc95c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.307124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 896/1775] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:07 2022] DELETE /identity/v3/projects/afa03d338c8c49629c3f4bb3ef599776 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:07.308609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.308961 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.309240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.331432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.332064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.332360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.332632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] PATH_INFO: `/v3/users/fc503df7f7164c59b2322d80cbbd57bb` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.333838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc503df7f7164c59b2322d80cbbd57bb)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.334152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:07.335412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.335797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.343828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 897/1776] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:07.345579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.346135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.358440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ef0f5-5059-4d28-bf34-1e906262bb04 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.363006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.363624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.363901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.364172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] PATH_INFO: `/v3/users/24a0f20bebb04cb5a3a15c316fe0ef3e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.365293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a0f20bebb04cb5a3a15c316fe0ef3e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.367406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.392441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc503df7f7164c59b2322d80cbbd57bb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.407026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc503df7f7164c59b2322d80cbbd57bb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.407737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc503df7f7164c59b2322d80cbbd57bb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.415101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc503df7f7164c59b2322d80cbbd57bb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.416114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc503df7f7164c59b2322d80cbbd57bb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.417018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a0f20bebb04cb5a3a15c316fe0ef3e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.417718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a0f20bebb04cb5a3a15c316fe0ef3e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.418334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a0f20bebb04cb5a3a15c316fe0ef3e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.431260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a0f20bebb04cb5a3a15c316fe0ef3e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.431679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 880/1777] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:07 2022] DELETE /identity/v3/users/fc503df7f7164c59b2322d80cbbd57bb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:07.435634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.437105 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.439069 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a4247cca-a6ad-4880-a9a6-28f66734825c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a0f20bebb04cb5a3a15c316fe0ef3e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.457090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 898/1778] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:07 2022] DELETE /identity/v3/users/24a0f20bebb04cb5a3a15c316fe0ef3e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:07.457090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.457090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.457090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.475233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:07.476499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.511584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e6db-b789-4c13-bff2-ae948c34fa01 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.539427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:07.580273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 899/1779] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:07.593428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.595329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.603328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.604566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.604879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.605351 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.606524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:07.606948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.608481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.625984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 881/1780] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:07.629369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.631144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.645210 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791414f2-6d1a-460d-9d44-3dda837e6abe admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.655261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.655878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.656152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.656421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.657084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.659032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.660593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:07.682364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b1d0d-9041-443b-882a-13d6ea5101a4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.691592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.692469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.692725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.693070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.705424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 882/1781] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:07 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:07.705618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.705618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.707471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.716030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 900/1782] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:07.788762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623bd49-9bfe-4531-9de7-145089c4b03b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.794868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.795575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.795856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.796150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.796843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.798813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.814108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.816354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:07.829844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 883/1783] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:07 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:07.830804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.838481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669dbf8-f4e6-40b5-85c0-cd21b8c0ee91 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.841078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817cdb9-fbb2-4eae-a14d-00a8b50eb566 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.843654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.844295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.844581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.844862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] PATH_INFO: `/v3/projects/d63234a9746144a5a1990a27398e516d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.846880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63234a9746144a5a1990a27398e516d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.847028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.848825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.850136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.850535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.850934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.851585 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.853898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.868330 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 884/1784] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:07.870280 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.882517 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f9555-780e-4c76-a668-e0639f92edac admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.900756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:07.901956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:07.902342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:07.902717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:07.903491 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:07.905807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:07.921697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 885/1785] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:59:07.926156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.940337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84005-14e7-4704-bac6-354bd3c20c16 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:07.943723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63234a9746144a5a1990a27398e516d', 'request_id': 'req-bb575bb8-1311-4cf5-b505-832ad1ce50f3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.952252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63234a9746144a5a1990a27398e516d', 'request_id': 'req-bb575bb8-1311-4cf5-b505-832ad1ce50f3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.960054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63234a9746144a5a1990a27398e516d', 'request_id': 'req-bb575bb8-1311-4cf5-b505-832ad1ce50f3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.980915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] The token cache is being invalidate because project d63234a9746144a5a1990a27398e516d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:07.981202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.981917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:07.985475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 901/1786] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:07 2022] DELETE /identity/v3/projects/d63234a9746144a5a1990a27398e516d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:07.988287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:07.991216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:08.003706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf9d77-be83-488b-94b0-b5463ccdffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:08.004375 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf9d77-be83-488b-94b0-b5463ccdffc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:08.004656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf9d77-be83-488b-94b0-b5463ccdffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:08.004931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf9d77-be83-488b-94b0-b5463ccdffc4 admin admin] PATH_INFO: `/v3/projects/17ca8d24fe0e4df3a4889c9e2f436eb0/users/d5a930354c0b4e3a9c8572bae8479686/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:08.007714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:08.024465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf9d77-be83-488b-94b0-b5463ccdffc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ca8d24fe0e4df3a4889c9e2f436eb0, user_id=d5a930354c0b4e3a9c8572bae8479686, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:08.027796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf9d77-be83-488b-94b0-b5463ccdffc4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:08.049703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 886/1787] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:07 2022] PUT /identity/v3/projects/17ca8d24fe0e4df3a4889c9e2f436eb0/users/d5a930354c0b4e3a9c8572bae8479686/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:08.060875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:08.061150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:08.062424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:08.091490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb575bb8-1311-4cf5-b505-832ad1ce50f3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:08.095103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] MFA Rules not processed for user `d5a930354c0b4e3a9c8572bae8479686`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:08.096521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:08.199890 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:08.200618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:08.201063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:08.201346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] PATH_INFO: `/v3/users/0df5a87e7a934bef9a168548eb6a19b0` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:08.202724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df5a87e7a934bef9a168548eb6a19b0)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:08.205001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:08.210312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 887/1788] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:08.211300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:08.212644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:08.223246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:08.236676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1812c-b686-4ca9-ad44-bd017ef52040 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:08.242566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:08.243441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:08.243715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:08.244038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] PATH_INFO: `/v3/projects/0e910ec819d348d1b3f31239dca0d865` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:08.245283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e910ec819d348d1b3f31239dca0d865)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:08.247384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:08.271623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df5a87e7a934bef9a168548eb6a19b0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.273107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df5a87e7a934bef9a168548eb6a19b0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.277919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df5a87e7a934bef9a168548eb6a19b0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.293486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df5a87e7a934bef9a168548eb6a19b0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.302141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df5a87e7a934bef9a168548eb6a19b0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.303316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e910ec819d348d1b3f31239dca0d865', 'request_id': 'req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.315226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e910ec819d348d1b3f31239dca0d865', 'request_id': 'req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.321482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 902/1789] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:07 2022] DELETE /identity/v3/users/0df5a87e7a934bef9a168548eb6a19b0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:08.324565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:08.324565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:08.338965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e910ec819d348d1b3f31239dca0d865', 'request_id': 'req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.357657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] The token cache is being invalidate because project 0e910ec819d348d1b3f31239dca0d865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:08.357831 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.358765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.360902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 888/1790] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:08 2022] DELETE /identity/v3/projects/0e910ec819d348d1b3f31239dca0d865 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:08.364588 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:08.366378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:08.416022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab83b4c-de2b-4e1b-987e-e340d1c384ce admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:08.420193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:08.421138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:08.421470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:08.421748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:08.424086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:08.465848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:08.473625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734031b0-9e5d-41c5-9c47-4218fc8e9a4e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:08.515098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:08.524816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:08.535958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 903/1791] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:08.570593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:08.571339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:08.571711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:08.572100 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] PATH_INFO: `/v3/users/04ed846543ec4410b6a721c1d0816f12` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:08.573420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ed846543ec4410b6a721c1d0816f12)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:08.575684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:08.683041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ed846543ec4410b6a721c1d0816f12'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.715063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ed846543ec4410b6a721c1d0816f12'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.717886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ed846543ec4410b6a721c1d0816f12'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.735047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ed846543ec4410b6a721c1d0816f12'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.735047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ed846543ec4410b6a721c1d0816f12'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.762606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:08.763989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:08.781968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 889/1792] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:08 2022] DELETE /identity/v3/users/04ed846543ec4410b6a721c1d0816f12 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:08.792850 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88fda1-7408-4c37-b79c-f1e2470f9f45 service glance] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:08.865717 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:08.886754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:08.887727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:08.888013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:08.888293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] PATH_INFO: `/v3/projects/36f0263458714a48aa45625d5f9724f9` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:08.889644 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f0263458714a48aa45625d5f9724f9)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:08.891594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:08.946963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f0263458714a48aa45625d5f9724f9', 'request_id': 'req-fd9d3386-5142-473c-a68b-5cf77f15fde1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.954007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f0263458714a48aa45625d5f9724f9', 'request_id': 'req-fd9d3386-5142-473c-a68b-5cf77f15fde1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.969970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f0263458714a48aa45625d5f9724f9', 'request_id': 'req-fd9d3386-5142-473c-a68b-5cf77f15fde1'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.984803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] The token cache is being invalidate because project 36f0263458714a48aa45625d5f9724f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:08.985121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.985991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-fd9d3386-5142-473c-a68b-5cf77f15fde1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:08.988641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 904/1793] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:08 2022] DELETE /identity/v3/projects/36f0263458714a48aa45625d5f9724f9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:09.139030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.141413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:09.166812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283610e-208a-46e9-b9e2-e55b2b90a170 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.238813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.239486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.239715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.239987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] PATH_INFO: `/v3/projects/49119f20c482438b973a25362bf8ed39` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.241147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49119f20c482438b973a25362bf8ed39)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.243122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.268703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:09.297162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49119f20c482438b973a25362bf8ed39', 'request_id': 'req-19fadd85-1d94-453c-8490-29e3326c116f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:09.303898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49119f20c482438b973a25362bf8ed39', 'request_id': 'req-19fadd85-1d94-453c-8490-29e3326c116f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:09.310244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49119f20c482438b973a25362bf8ed39', 'request_id': 'req-19fadd85-1d94-453c-8490-29e3326c116f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:09.324588 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] The token cache is being invalidate because project 49119f20c482438b973a25362bf8ed39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:09.324892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:09.325554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-19fadd85-1d94-453c-8490-29e3326c116f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:09.327153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 890/1794] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:09 2022] DELETE /identity/v3/projects/49119f20c482438b973a25362bf8ed39 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:09.332060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f42da-c2ec-4575-b34f-e154052a9520 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.332529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f42da-c2ec-4575-b34f-e154052a9520 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.332617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f42da-c2ec-4575-b34f-e154052a9520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.358059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-822f42da-c2ec-4575-b34f-e154052a9520 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:09.359275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-822f42da-c2ec-4575-b34f-e154052a9520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:09.420923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 905/1795] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:09.429102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17f66-a632-439b-b69a-d85c554e48c7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.429405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17f66-a632-439b-b69a-d85c554e48c7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.429682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17f66-a632-439b-b69a-d85c554e48c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.452641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-b7c17f66-a632-439b-b69a-d85c554e48c7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:09.453879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b7c17f66-a632-439b-b69a-d85c554e48c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:09.463029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 891/1796] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:09.468927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f42da-c2ec-4575-b34f-e154052a9520 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.478607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f42da-c2ec-4575-b34f-e154052a9520 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.483180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.483775 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.484053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.484323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.484968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:09.485297 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.487122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.504136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 906/1797] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:09.505348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c17f66-a632-439b-b69a-d85c554e48c7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.515293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c17f66-a632-439b-b69a-d85c554e48c7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.521238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.521993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.522263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.522535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.523215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.525149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.558113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 892/1798] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:09 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:09.563554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.574927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae301c81-b8d0-424f-865d-b9597ec22b04 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.634678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.635365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.635587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.635865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.636490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.638584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.648470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:09.663678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 907/1799] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:09 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:09.666943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.677442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adba97d-a0cb-45fc-b58c-90951ef7de29 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.682305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.682870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.683146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.683419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.684054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.685683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.696112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 893/1800] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:09.700512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.711117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de871ab-be26-460c-9439-808ccab8d623 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.717573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b55b41-d43c-4fd9-995b-9ca83b0efc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.718204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b55b41-d43c-4fd9-995b-9ca83b0efc9b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.718561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b55b41-d43c-4fd9-995b-9ca83b0efc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.718816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b55b41-d43c-4fd9-995b-9ca83b0efc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.719572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b55b41-d43c-4fd9-995b-9ca83b0efc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.722149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b55b41-d43c-4fd9-995b-9ca83b0efc9b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.734913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 908/1801] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:09.739913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.751381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044ed5d-b056-4b20-970f-a5c3ddf3311c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.756994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.757676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.757994 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.758230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] PATH_INFO: `/v3/projects/aa8fb92457dc4ce683cb7359e7e112ec/users/b266fa58f2db4adba39864a6e24e69f5/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.774181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa8fb92457dc4ce683cb7359e7e112ec, user_id=b266fa58f2db4adba39864a6e24e69f5, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.777229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:09.791396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 894/1802] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:09 2022] PUT /identity/v3/projects/aa8fb92457dc4ce683cb7359e7e112ec/users/b266fa58f2db4adba39864a6e24e69f5/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:09.802998 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c84c8-0fec-491e-a95a-6cbbad41ec86 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.803417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c84c8-0fec-491e-a95a-6cbbad41ec86 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.803809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c84c8-0fec-491e-a95a-6cbbad41ec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.833936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c05c84c8-0fec-491e-a95a-6cbbad41ec86 None None] MFA Rules not processed for user `b266fa58f2db4adba39864a6e24e69f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:09.835350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c05c84c8-0fec-491e-a95a-6cbbad41ec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:09.908126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 909/1803] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:09.913468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:09.984409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fc988-d0dc-43c1-b4ae-d0421f1201b2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:09.990223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:09.991265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:09.991693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:09.992130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:09.992805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:09.995020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.027789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 895/1804] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:09 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:10.031835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c84c8-0fec-491e-a95a-6cbbad41ec86 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.043269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c84c8-0fec-491e-a95a-6cbbad41ec86 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.114707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.115593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.115950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.116470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.117132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.119359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.147052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 910/1805] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:10 2022] POST /identity/v3/users => generated 290 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:10.151119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.163039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1103b4-7029-4315-944c-7f96f4861d06 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.167383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.168015 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.168281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.168546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.169247 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.170869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.182887 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 896/1806] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:59:10.188085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.200387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69853d5f-bb8b-4dd2-9866-5892b261326d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.213581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.213581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.213581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.213581 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] PATH_INFO: `/v3/projects/a695d7148bf442c383b18753a47b8ca3/users/7dd07a85da8c4630995053f902fced4e/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.226829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a695d7148bf442c383b18753a47b8ca3, user_id=7dd07a85da8c4630995053f902fced4e, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.229509 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.246555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 911/1807] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:10 2022] PUT /identity/v3/projects/a695d7148bf442c383b18753a47b8ca3/users/7dd07a85da8c4630995053f902fced4e/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:10.247740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.263005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71497e-4876-46b3-9fa7-205f178ed9ef admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.283912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:10.328900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919cc74-5e66-41e7-8f51-8d00b769e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.329543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919cc74-5e66-41e7-8f51-8d00b769e4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.329818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919cc74-5e66-41e7-8f51-8d00b769e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.330213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919cc74-5e66-41e7-8f51-8d00b769e4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.330872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919cc74-5e66-41e7-8f51-8d00b769e4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.332546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919cc74-5e66-41e7-8f51-8d00b769e4b5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.343523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 897/1808] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:59:10.348118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.372916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e724b-433b-46be-8086-63ae407eb615 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.378050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.379043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.379321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.379596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] PATH_INFO: `/v3/projects/a695d7148bf442c383b18753a47b8ca3/users/7dd07a85da8c4630995053f902fced4e/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.381607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a695d7148bf442c383b18753a47b8ca3, user_id=7dd07a85da8c4630995053f902fced4e, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.384342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.395336 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 912/1809] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:10 2022] PUT /identity/v3/projects/a695d7148bf442c383b18753a47b8ca3/users/7dd07a85da8c4630995053f902fced4e/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:10.406046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120b46-c8f2-47bc-8e02-48fd892e8447 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.406314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120b46-c8f2-47bc-8e02-48fd892e8447 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.406608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03120b46-c8f2-47bc-8e02-48fd892e8447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.436718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-03120b46-c8f2-47bc-8e02-48fd892e8447 None None] MFA Rules not processed for user `7dd07a85da8c4630995053f902fced4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:10.437833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-03120b46-c8f2-47bc-8e02-48fd892e8447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.512097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 898/1810] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:10.524152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.526321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:10.554726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:10.591192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6295-be93-4618-9ad9-829ffca6f9d6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.595098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.595799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.596162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.596472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.606495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.607946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.618142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 913/1811] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:10.708628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03120b46-c8f2-47bc-8e02-48fd892e8447 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:10.719540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03120b46-c8f2-47bc-8e02-48fd892e8447 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:10.724489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff200251-a3d6-4b68-8dd4-e8b309539a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:10.725166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff200251-a3d6-4b68-8dd4-e8b309539a18 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:10.725663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff200251-a3d6-4b68-8dd4-e8b309539a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:10.725996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff200251-a3d6-4b68-8dd4-e8b309539a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:10.793313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff200251-a3d6-4b68-8dd4-e8b309539a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:10.794960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff200251-a3d6-4b68-8dd4-e8b309539a18 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:10.805809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 899/1812] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:15.828400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:15.900046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7f0e7-924c-4be2-b935-7f04f68068c8 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:15.905746 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:15.906478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:15.906765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:15.907035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] PATH_INFO: `/v3/users/b266fa58f2db4adba39864a6e24e69f5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:15.908304 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b266fa58f2db4adba39864a6e24e69f5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:15.910310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:15.961849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b266fa58f2db4adba39864a6e24e69f5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:15.962599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b266fa58f2db4adba39864a6e24e69f5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:15.963202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b266fa58f2db4adba39864a6e24e69f5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:15.976914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b266fa58f2db4adba39864a6e24e69f5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:15.985323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b266fa58f2db4adba39864a6e24e69f5'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:15.999737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 914/1813] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:15 2022] DELETE /identity/v3/users/b266fa58f2db4adba39864a6e24e69f5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:16.005454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.007188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.007673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.031694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:16.032921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:16.077826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:16.102539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 900/1814] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:16.112974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:16.114621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:16.172035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:16.187313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c3b22-5e9a-4fec-98de-199aba148343 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:16.191904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:16.192539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.192817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.193089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.205199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:16.206709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:16.217308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 915/1815] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:16.550493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:16.552121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:16.574899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dea03-d03e-4dc4-8e61-b5940cd90f00 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:16.593262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:16.594422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.594896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.595361 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] PATH_INFO: `/v3/projects/aa8fb92457dc4ce683cb7359e7e112ec` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.602918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa8fb92457dc4ce683cb7359e7e112ec)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:16.605042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:16.666071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8fb92457dc4ce683cb7359e7e112ec', 'request_id': 'req-11dba295-92b7-436b-ba55-aff3f943c454'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.673417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8fb92457dc4ce683cb7359e7e112ec', 'request_id': 'req-11dba295-92b7-436b-ba55-aff3f943c454'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.681459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8fb92457dc4ce683cb7359e7e112ec', 'request_id': 'req-11dba295-92b7-436b-ba55-aff3f943c454'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.696023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] The token cache is being invalidate because project aa8fb92457dc4ce683cb7359e7e112ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:16.696317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.696993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.698815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 901/1816] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:16 2022] DELETE /identity/v3/projects/aa8fb92457dc4ce683cb7359e7e112ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:16.705203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:16.719025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c11766-4aa5-4f45-bca5-01562461ccd9 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:16.792649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:16.793196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:16.793506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:16.793774 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] PATH_INFO: `/v3/users/7dd07a85da8c4630995053f902fced4e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:16.795089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd07a85da8c4630995053f902fced4e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:16.797237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:16.862927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd07a85da8c4630995053f902fced4e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.863846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd07a85da8c4630995053f902fced4e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.864214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd07a85da8c4630995053f902fced4e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.878945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd07a85da8c4630995053f902fced4e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.887798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3bc0b4fa-bbd2-4484-bec9-21de46f64bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd07a85da8c4630995053f902fced4e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:16.905122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 916/1817] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:16 2022] DELETE /identity/v3/users/7dd07a85da8c4630995053f902fced4e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:17.308323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.310736 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:17.325790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba295-92b7-436b-ba55-aff3f943c454 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.404699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.405332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.405645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.405921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] PATH_INFO: `/v3/projects/a695d7148bf442c383b18753a47b8ca3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.407119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a695d7148bf442c383b18753a47b8ca3)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.409077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.468990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a695d7148bf442c383b18753a47b8ca3', 'request_id': 'req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:17.476289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a695d7148bf442c383b18753a47b8ca3', 'request_id': 'req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:17.485218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a695d7148bf442c383b18753a47b8ca3', 'request_id': 'req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:17.489931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:17.500880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] The token cache is being invalidate because project a695d7148bf442c383b18753a47b8ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:17.501155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:17.501939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a74c9895-2ec4-4ff2-9d30-e9dc5244537d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:17.504043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 902/1818] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:17 2022] DELETE /identity/v3/projects/a695d7148bf442c383b18753a47b8ca3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:17.510033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b0dc-c950-4787-a591-71b83be76bd9 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.510312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b0dc-c950-4787-a591-71b83be76bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.510580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b0dc-c950-4787-a591-71b83be76bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.532774 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d3e6b0dc-c950-4787-a591-71b83be76bd9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:17.533955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d3e6b0dc-c950-4787-a591-71b83be76bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:17.614493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 917/1819] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:17.626477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbd94-8621-444c-8b69-c9c3a719b856 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.627113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbd94-8621-444c-8b69-c9c3a719b856 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.627603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcfbd94-8621-444c-8b69-c9c3a719b856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.665437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6bcfbd94-8621-444c-8b69-c9c3a719b856 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:17.666732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6bcfbd94-8621-444c-8b69-c9c3a719b856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:17.685708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 903/1820] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:17.698302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6b0dc-c950-4787-a591-71b83be76bd9 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.709494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6b0dc-c950-4787-a591-71b83be76bd9 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.716478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.717175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.717493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.717766 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.718438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:17.718749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.720678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.728821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:17.737189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 918/1821] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:17.743750 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbd94-8621-444c-8b69-c9c3a719b856 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.756028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcfbd94-8621-444c-8b69-c9c3a719b856 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.760910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.761690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.762148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.762416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.763047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.764941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.805560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 904/1822] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:17 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:17.810001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.821143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3ba7c-d58d-440a-86d4-80a9faefb167 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.894009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.894728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.894873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.895239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.896114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.898828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.929139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 919/1823] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:17 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:17.934016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.945722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4992-4dff-4789-9a61-e360ab025103 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.951051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.951655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.951928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.952518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.952834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.954902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:17.967319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 905/1824] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:17.974463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:17.986146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f793a-088f-4af1-8fa0-18cd0204d509 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:17.992239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fe53c-0f20-4930-9daf-f1c4df8cb365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:17.993002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe53c-0f20-4930-9daf-f1c4df8cb365 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:17.993346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe53c-0f20-4930-9daf-f1c4df8cb365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:17.993674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fe53c-0f20-4930-9daf-f1c4df8cb365 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:17.994358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe53c-0f20-4930-9daf-f1c4df8cb365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:17.995986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4fe53c-0f20-4930-9daf-f1c4df8cb365 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.007862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 920/1825] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:18.012383 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.023294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f008448-151c-4e3f-bda6-c605ca31bdf0 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.028210 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.028882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.029161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.029481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] PATH_INFO: `/v3/projects/f7cc260fb0c6433a983eb431b45ea54c/users/e1564e560a83405d83181f6e45cd147d/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.048759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cc260fb0c6433a983eb431b45ea54c, user_id=e1564e560a83405d83181f6e45cd147d, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.051506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.073010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 906/1826] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:18 2022] PUT /identity/v3/projects/f7cc260fb0c6433a983eb431b45ea54c/users/e1564e560a83405d83181f6e45cd147d/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:18.083880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ec4a-ec0b-452b-ba6f-9bee045ddbcf None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.084172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ec4a-ec0b-452b-ba6f-9bee045ddbcf None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.084470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522ec4a-ec0b-452b-ba6f-9bee045ddbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.115355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2522ec4a-ec0b-452b-ba6f-9bee045ddbcf None None] MFA Rules not processed for user `e1564e560a83405d83181f6e45cd147d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:18.116644 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2522ec4a-ec0b-452b-ba6f-9bee045ddbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:18.189679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 921/1827] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:18.195197 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.275305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cd88d-82e5-41e2-8828-5c84ffa10f12 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.280703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.281511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.281789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.282075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.282717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.284704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.315793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 907/1828] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:18 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:18.320149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ec4a-ec0b-452b-ba6f-9bee045ddbcf None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.331776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522ec4a-ec0b-452b-ba6f-9bee045ddbcf None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.406858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.407575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.407847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.408112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.408813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.410906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.422065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:18.442016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 922/1829] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:18 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:18.446553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.457697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b47bf-5aee-4cc7-9304-a327af2f5f20 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.462539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.463151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.463428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.463697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.464329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.465989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.478531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 908/1830] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:18.482891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.494493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa86412-6397-433a-9e2d-1d176c9b32ce admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.499158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.499821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.500103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.500372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] PATH_INFO: `/v3/projects/5e37677374284fd78f118957ee5ebb2d/users/5ab6acb271d842f49763cb75250c2771/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.517793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e37677374284fd78f118957ee5ebb2d, user_id=5ab6acb271d842f49763cb75250c2771, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.520613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.538737 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 923/1831] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:18 2022] PUT /identity/v3/projects/5e37677374284fd78f118957ee5ebb2d/users/5ab6acb271d842f49763cb75250c2771/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 19:59:18.544073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.556170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848726f8-2ec8-4e47-afd1-a1c06bcbcbb4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.654045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6310720-bbeb-4510-baef-cd4123c0f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.654667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6310720-bbeb-4510-baef-cd4123c0f117 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.654947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6310720-bbeb-4510-baef-cd4123c0f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.655218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6310720-bbeb-4510-baef-cd4123c0f117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.655861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6310720-bbeb-4510-baef-cd4123c0f117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.657570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6310720-bbeb-4510-baef-cd4123c0f117 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.670151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 909/1832] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:18 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:18.676542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.687776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560e40b-a086-4af3-a256-ed2e0078ad8d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.693659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.694269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.694543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.694816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] PATH_INFO: `/v3/projects/5e37677374284fd78f118957ee5ebb2d/users/5ab6acb271d842f49763cb75250c2771/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.696843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e37677374284fd78f118957ee5ebb2d, user_id=5ab6acb271d842f49763cb75250c2771, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.699559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.712302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 924/1833] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:18 2022] PUT /identity/v3/projects/5e37677374284fd78f118957ee5ebb2d/users/5ab6acb271d842f49763cb75250c2771/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:18.724369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46865-60db-46f2-91c3-bca43387f349 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.724369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46865-60db-46f2-91c3-bca43387f349 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.724369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46865-60db-46f2-91c3-bca43387f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.732877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:18.765319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5af46865-60db-46f2-91c3-bca43387f349 None None] MFA Rules not processed for user `5ab6acb271d842f49763cb75250c2771`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:18.766568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5af46865-60db-46f2-91c3-bca43387f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:18.865105 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 910/1834] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:18.876327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:18.878517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:18.945019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805bf632-51b6-4fc5-99e9-ebd4adc3998c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:18.953041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a5afb-13cd-4ce7-8e5a-bf30545a8d20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:18.953828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5afb-13cd-4ce7-8e5a-bf30545a8d20 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:18.954170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5afb-13cd-4ce7-8e5a-bf30545a8d20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:18.954448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5afb-13cd-4ce7-8e5a-bf30545a8d20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:18.974313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a5afb-13cd-4ce7-8e5a-bf30545a8d20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:18.975868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a5afb-13cd-4ce7-8e5a-bf30545a8d20 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:18.986602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 925/1835] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:19.418196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46865-60db-46f2-91c3-bca43387f349 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:19.489958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46865-60db-46f2-91c3-bca43387f349 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:19.495598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:19.496248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:19.496528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:19.496801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] PATH_INFO: `/v3/users/e1564e560a83405d83181f6e45cd147d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:19.498070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1564e560a83405d83181f6e45cd147d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:19.500016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:19.554638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1564e560a83405d83181f6e45cd147d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:19.568618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1564e560a83405d83181f6e45cd147d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:19.569413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1564e560a83405d83181f6e45cd147d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:19.577881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1564e560a83405d83181f6e45cd147d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:19.578612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1564e560a83405d83181f6e45cd147d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:19.596809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 911/1836] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:19 2022] DELETE /identity/v3/users/e1564e560a83405d83181f6e45cd147d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:19.601645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:19.601951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:19.602220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:19.621279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:19.622510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:19.692879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 926/1837] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:19.703328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:19.704931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:19.716094 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:19.774451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee535da7-391c-4e81-8d91-51f07a6f1604 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:19.778844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:19.780089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:19.780089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:19.780089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:19.790761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:19.792206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:19.802641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 912/1838] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:20.113671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:20.115123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:20.128851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b910e1-1454-4da7-a835-42c2d66e56b6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:20.145422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:20.146034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.146501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.146599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] PATH_INFO: `/v3/projects/f7cc260fb0c6433a983eb431b45ea54c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:20.148034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cc260fb0c6433a983eb431b45ea54c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:20.150038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:20.202710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cc260fb0c6433a983eb431b45ea54c', 'request_id': 'req-d537fabd-4974-4c8c-a003-d838c9e8a48b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.204677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:20.211968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cc260fb0c6433a983eb431b45ea54c', 'request_id': 'req-d537fabd-4974-4c8c-a003-d838c9e8a48b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.222650 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cc260fb0c6433a983eb431b45ea54c', 'request_id': 'req-d537fabd-4974-4c8c-a003-d838c9e8a48b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.236204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] The token cache is being invalidate because project f7cc260fb0c6433a983eb431b45ea54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:20.236502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.237094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.238603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 927/1839] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:20 2022] DELETE /identity/v3/projects/f7cc260fb0c6433a983eb431b45ea54c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:20.243147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:20.253543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a106cd-0d6c-43ee-8e33-0e47b667eae2 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:20.324156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:20.324804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.325075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.325363 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] PATH_INFO: `/v3/users/5ab6acb271d842f49763cb75250c2771` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:20.326565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab6acb271d842f49763cb75250c2771)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:20.328555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:20.394400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab6acb271d842f49763cb75250c2771'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.411335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab6acb271d842f49763cb75250c2771'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.412308 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab6acb271d842f49763cb75250c2771'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.422649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab6acb271d842f49763cb75250c2771'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.423903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-12603ee4-2bb5-4beb-b5ad-d8f9886ab0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab6acb271d842f49763cb75250c2771'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.443036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 913/1840] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:20 2022] DELETE /identity/v3/users/5ab6acb271d842f49763cb75250c2771 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:20.792657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:20.794811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:20.819597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537fabd-4974-4c8c-a003-d838c9e8a48b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:20.893929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:20.894915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.894915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.895101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] PATH_INFO: `/v3/projects/5e37677374284fd78f118957ee5ebb2d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:20.896703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e37677374284fd78f118957ee5ebb2d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:20.898353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:20.949883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e37677374284fd78f118957ee5ebb2d', 'request_id': 'req-15459cc6-a3c5-465f-a030-cd6a2976308b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.959310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e37677374284fd78f118957ee5ebb2d', 'request_id': 'req-15459cc6-a3c5-465f-a030-cd6a2976308b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.966824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e37677374284fd78f118957ee5ebb2d', 'request_id': 'req-15459cc6-a3c5-465f-a030-cd6a2976308b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.981968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] The token cache is being invalidate because project 5e37677374284fd78f118957ee5ebb2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:20.982259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.982905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-15459cc6-a3c5-465f-a030-cd6a2976308b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:20.984437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 928/1841] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:20 2022] DELETE /identity/v3/projects/5e37677374284fd78f118957ee5ebb2d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:20.991562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb9b2-f755-4239-ac28-33cfd88541c4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:20.991816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb9b2-f755-4239-ac28-33cfd88541c4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:20.992083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bb9b2-f755-4239-ac28-33cfd88541c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.016742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-657bb9b2-f755-4239-ac28-33cfd88541c4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:21.018087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-657bb9b2-f755-4239-ac28-33cfd88541c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:21.043959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:21.088165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 914/1842] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:21.096745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd748c8-bbea-474d-963c-03e354b2914c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.097032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd748c8-bbea-474d-963c-03e354b2914c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.097396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd748c8-bbea-474d-963c-03e354b2914c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.120160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-efd748c8-bbea-474d-963c-03e354b2914c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:21.121492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-efd748c8-bbea-474d-963c-03e354b2914c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:21.130426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 929/1843] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:21.135274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bb9b2-f755-4239-ac28-33cfd88541c4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.147659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bb9b2-f755-4239-ac28-33cfd88541c4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.152976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.153799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.154075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.154346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.155023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:21.155336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.157029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.172337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 915/1844] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:21.178536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd748c8-bbea-474d-963c-03e354b2914c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.191208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd748c8-bbea-474d-963c-03e354b2914c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.201208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.201987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.202355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.202657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.203618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.205913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.241866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 930/1845] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:21.246311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.257666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5f79b-4a44-4de8-b760-ee6844e73577 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.331680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.332352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.332632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.332900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.333569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.336480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.367453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 916/1846] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 19:59:21.370845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.381900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132bcc-743e-4cfb-a48b-e57ba52a8bfa admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.388904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.395915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.395915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.395915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.395915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.395915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.412444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 931/1847] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:21.417431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.431378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64f174-7a17-4a43-964f-e91f0a4e144c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.438026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5598cad-3109-40bc-8713-4cb89e3cc11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.439447 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598cad-3109-40bc-8713-4cb89e3cc11a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.439901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598cad-3109-40bc-8713-4cb89e3cc11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.440275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5598cad-3109-40bc-8713-4cb89e3cc11a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.441245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5598cad-3109-40bc-8713-4cb89e3cc11a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.443519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5598cad-3109-40bc-8713-4cb89e3cc11a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.455943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 917/1848] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:59:21.460751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.471782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9974f-d3e7-4bfa-9e5d-214d54f8bbba admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.477621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.478505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.478820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.479091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] PATH_INFO: `/v3/projects/a66a453b660a4f099920d147b98aec6d/users/980babf1bead4d6ea38714377eea9d99/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.498320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66a453b660a4f099920d147b98aec6d, user_id=980babf1bead4d6ea38714377eea9d99, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.501296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.517405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 932/1849] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:21 2022] PUT /identity/v3/projects/a66a453b660a4f099920d147b98aec6d/users/980babf1bead4d6ea38714377eea9d99/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:21.522659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea340-afb2-4c85-aa55-a97bf2c4c554 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.522942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea340-afb2-4c85-aa55-a97bf2c4c554 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.523212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdea340-afb2-4c85-aa55-a97bf2c4c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.553767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4bdea340-afb2-4c85-aa55-a97bf2c4c554 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:21.555077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4bdea340-afb2-4c85-aa55-a97bf2c4c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:21.626404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 918/1850] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:59:21.642928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:21.645664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:21.657048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:21.729481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014721fa-86dc-4432-a89e-56ce993cf542 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:21.734452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:21.735089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:21.735365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:21.736031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:21.746724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:21.748121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:21.759502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 933/1851] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:22.592784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e1e7-e381-4c8d-82e7-5d3a0e681602 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.593557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e1e7-e381-4c8d-82e7-5d3a0e681602 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.593776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0e1e7-e381-4c8d-82e7-5d3a0e681602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.640684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1db0e1e7-e381-4c8d-82e7-5d3a0e681602 None None] MFA Rules not processed for user `980babf1bead4d6ea38714377eea9d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:22.642205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1db0e1e7-e381-4c8d-82e7-5d3a0e681602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:22.674374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:22.736712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 919/1852] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:22.749143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:22.751038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:22.815414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024fee25-806c-4f4c-be5a-dad6aa8501fe service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:22.819322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:22.819962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:22.820247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:22.820533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:22.830097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:22.831563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:22.841807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 934/1853] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:24.301296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14178-e47d-4902-81d4-90b25204baf1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:24.301840 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14178-e47d-4902-81d4-90b25204baf1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:24.301840 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa14178-e47d-4902-81d4-90b25204baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:24.323402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-caa14178-e47d-4902-81d4-90b25204baf1 None None] MFA Rules not processed for user `980babf1bead4d6ea38714377eea9d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:24.324600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-caa14178-e47d-4902-81d4-90b25204baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:24.332483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 920/1854] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:32.836812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=49 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:33.853478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:33.855344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:33.870582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269d7d4-942b-4633-9961-2100fd9b6faf service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:33.876094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:33.876726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:33.877004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:33.877689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] PATH_INFO: `/v3/users/d5a930354c0b4e3a9c8572bae8479686` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:33.878902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a930354c0b4e3a9c8572bae8479686)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:33.880891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:33.937050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a930354c0b4e3a9c8572bae8479686'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:33.937697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a930354c0b4e3a9c8572bae8479686'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:33.938298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a930354c0b4e3a9c8572bae8479686'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:33.952021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a930354c0b4e3a9c8572bae8479686'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:33.967891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a930354c0b4e3a9c8572bae8479686'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:33.977520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 935/1855] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 19:59:33 2022] DELETE /identity/v3/users/d5a930354c0b4e3a9c8572bae8479686 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:33.982854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:33.983803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:33.984404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:34.005336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:34.006645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:34.065909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 921/1856] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:34.076308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:34.077999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:34.160578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372171f-44aa-45af-b053-b52c83c5d8dd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:34.171727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625735b5-f8de-488d-9909-6ec46ed52d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:34.171727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625735b5-f8de-488d-9909-6ec46ed52d4f service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:34.171727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625735b5-f8de-488d-9909-6ec46ed52d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:34.171727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625735b5-f8de-488d-9909-6ec46ed52d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:34.190851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625735b5-f8de-488d-9909-6ec46ed52d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:34.193441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625735b5-f8de-488d-9909-6ec46ed52d4f service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:34.204674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 936/1857] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:34.613029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:34.615286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:34.652063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373bbd7-70c8-4677-8088-3c5480d4b022 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:34.679811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:34.679811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:34.679811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:34.679811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] PATH_INFO: `/v3/projects/17ca8d24fe0e4df3a4889c9e2f436eb0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:34.680156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ca8d24fe0e4df3a4889c9e2f436eb0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:34.681272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:34.802809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ca8d24fe0e4df3a4889c9e2f436eb0', 'request_id': 'req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:34.812574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ca8d24fe0e4df3a4889c9e2f436eb0', 'request_id': 'req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:34.819657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ca8d24fe0e4df3a4889c9e2f436eb0', 'request_id': 'req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:34.833665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] The token cache is being invalidate because project 17ca8d24fe0e4df3a4889c9e2f436eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 19:59:34.833948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:34.834577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-bcfbf2c6-ea2c-43a9-8132-2bf2b52c2f93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 19:59:34.836170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 922/1858] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 19:59:34 2022] DELETE /identity/v3/projects/17ca8d24fe0e4df3a4889c9e2f436eb0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:34.841264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095cf9-6878-424e-993f-2faa6b9c3d29 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:34.843556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095cf9-6878-424e-993f-2faa6b9c3d29 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:34.843556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6095cf9-6878-424e-993f-2faa6b9c3d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:34.862647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d6095cf9-6878-424e-993f-2faa6b9c3d29 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:34.864119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d6095cf9-6878-424e-993f-2faa6b9c3d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:34.929866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 937/1859] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:34.938972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0c0b6-c6dc-4c69-8be5-5b056b4440e9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:34.939747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0c0b6-c6dc-4c69-8be5-5b056b4440e9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:34.940194 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c0c0b6-c6dc-4c69-8be5-5b056b4440e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:34.963343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c7c0c0b6-c6dc-4c69-8be5-5b056b4440e9 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:34.964120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c7c0c0b6-c6dc-4c69-8be5-5b056b4440e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:34.973966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 923/1860] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 19:59:34.979146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6095cf9-6878-424e-993f-2faa6b9c3d29 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:34.992108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6095cf9-6878-424e-993f-2faa6b9c3d29 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:34.997253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:34.997951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:34.998230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:34.998499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:34.999158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 19:59:34.999747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:35.001669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:35.021415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 938/1861] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 19:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 19:59:35.022384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0c0b6-c6dc-4c69-8be5-5b056b4440e9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:35.041167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c0c0b6-c6dc-4c69-8be5-5b056b4440e9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:35.050712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:35.051623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:35.052131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:35.052614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:35.053521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:35.055772 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:35.100913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 924/1862] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 19:59:35 2022] POST /identity/v3/projects => generated 365 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:35.101839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:35.107664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:35.114220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac0474-dd7a-46fc-a0a9-77b313e4b80f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:35.177456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:35.178085 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:35.178362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:35.178671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:35.179262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:35.181184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:35.208228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 939/1863] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 19:59:35 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 19:59:35.209604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:35.220875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4193e8e-219b-4de8-9b6a-6c57212574a2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:35.225922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:35.226535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:35.226809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:35.227209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:35.227980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:35.229911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:35.240935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 925/1864] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 19:59:35.245079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:35.255381 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40135e-3be0-449b-8a3e-0b0d68b6becf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:35.262323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095df937-b631-4095-b565-7c016418a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:35.262928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095df937-b631-4095-b565-7c016418a4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:35.263210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095df937-b631-4095-b565-7c016418a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:35.263476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095df937-b631-4095-b565-7c016418a4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:35.264113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095df937-b631-4095-b565-7c016418a4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:35.265763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095df937-b631-4095-b565-7c016418a4fc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:35.277265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 940/1865] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 19:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 19:59:35.281971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:35.289142 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:35.297171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d638e-ff05-4b36-be72-00a8158de360 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:35.303770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:35.306221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:35.306997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:35.306997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] PATH_INFO: `/v3/projects/0669c30f17b54c61968e21a739d07407/users/2f9118f115ab4503b9edc558089cba6a/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:35.329023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0669c30f17b54c61968e21a739d07407, user_id=2f9118f115ab4503b9edc558089cba6a, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:35.332001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:35.350454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 926/1866] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 19:59:35 2022] PUT /identity/v3/projects/0669c30f17b54c61968e21a739d07407/users/2f9118f115ab4503b9edc558089cba6a/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 19:59:35.361362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a431ac4-3c32-43cb-a50a-423f62b06545 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:35.361864 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a431ac4-3c32-43cb-a50a-423f62b06545 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:35.362141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a431ac4-3c32-43cb-a50a-423f62b06545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:35.398046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0a431ac4-3c32-43cb-a50a-423f62b06545 None None] MFA Rules not processed for user `2f9118f115ab4503b9edc558089cba6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:35.399514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0a431ac4-3c32-43cb-a50a-423f62b06545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:35.505963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 941/1867] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:35.518928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:35.521334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:35.606168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adb29-d36e-4ca7-92ce-42d901087fc4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:35.610548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b637db-7566-489c-83af-6bf554a05e6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:35.611163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b637db-7566-489c-83af-6bf554a05e6d service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:35.611438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b637db-7566-489c-83af-6bf554a05e6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:35.611708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b637db-7566-489c-83af-6bf554a05e6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:35.621272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b637db-7566-489c-83af-6bf554a05e6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:35.622760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b637db-7566-489c-83af-6bf554a05e6d service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:35.634187 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 927/1868] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 19:59:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 19:59:36.881179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073e80-51b3-4dde-94d7-0c333e650141 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:36.881706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073e80-51b3-4dde-94d7-0c333e650141 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:36.881898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db073e80-51b3-4dde-94d7-0c333e650141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:36.924778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-db073e80-51b3-4dde-94d7-0c333e650141 None None] MFA Rules not processed for user `d4967aae8aa544d0b3da824976e0d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:36.926056 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-db073e80-51b3-4dde-94d7-0c333e650141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:36.982909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 942/1869] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:41.070587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1009e91-6544-45e5-9850-f00900747901 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:41.071177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1009e91-6544-45e5-9850-f00900747901 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:41.071177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1009e91-6544-45e5-9850-f00900747901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:41.095799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a1009e91-6544-45e5-9850-f00900747901 None None] MFA Rules not processed for user `df9070301e814527a887aee5c266226f`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:41.097026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a1009e91-6544-45e5-9850-f00900747901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:41.209430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 928/1870] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:46.749339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:46.749905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:46.749905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:46.771239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] MFA Rules not processed for user `980babf1bead4d6ea38714377eea9d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:46.772450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:46.785155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 19:59:46.865729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 943/1871] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 19:59:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:51.093526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0c848-4a20-4897-a9d6-06794368c91f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:51.094079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0c848-4a20-4897-a9d6-06794368c91f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:51.094079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0c848-4a20-4897-a9d6-06794368c91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:51.116626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1dd0c848-4a20-4897-a9d6-06794368c91f None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 19:59:51.118502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1dd0c848-4a20-4897-a9d6-06794368c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:51.201445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 929/1872] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 19:59:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 19:59:51.279080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 19:59:51.280691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 19:59:51.427119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a35a2-c45f-4f35-86fb-56519292a2ad None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 19:59:51.433314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0028b-99f3-474a-89d4-186bb3ac4197 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 19:59:51.434377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0028b-99f3-474a-89d4-186bb3ac4197 service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 19:59:51.434810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0028b-99f3-474a-89d4-186bb3ac4197 service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 19:59:51.435230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0028b-99f3-474a-89d4-186bb3ac4197 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 19:59:51.444683 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0028b-99f3-474a-89d4-186bb3ac4197 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 19:59:51.447079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0028b-99f3-474a-89d4-186bb3ac4197 service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 19:59:51.459718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 944/1873] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 19:59:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:00:01.192045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=85,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:01.454865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=50 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:08.069974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75781-c5c1-48db-bf4d-09158b9de9fd None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.069974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75781-c5c1-48db-bf4d-09158b9de9fd None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.069974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75781-c5c1-48db-bf4d-09158b9de9fd None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.070859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 930/1874] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 20:00:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:00:08.076871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1519-19bd-42b3-8e21-284769410de7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.077562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1519-19bd-42b3-8e21-284769410de7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.077562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1519-19bd-42b3-8e21-284769410de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.098018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3c2c1519-19bd-42b3-8e21-284769410de7 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:08.099268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3c2c1519-19bd-42b3-8e21-284769410de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:08.174750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 945/1875] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 20:00:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:08.189621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75781-c5c1-48db-bf4d-09158b9de9fd None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:08.191700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b1c75781-c5c1-48db-bf4d-09158b9de9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:08.263446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75781-c5c1-48db-bf4d-09158b9de9fd None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:08.266956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906d287-294f-40ca-ba3a-db2f29df842b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:08.267700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906d287-294f-40ca-ba3a-db2f29df842b service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.267973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906d287-294f-40ca-ba3a-db2f29df842b service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.268294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906d287-294f-40ca-ba3a-db2f29df842b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.280144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906d287-294f-40ca-ba3a-db2f29df842b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:08.281700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906d287-294f-40ca-ba3a-db2f29df842b service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:08.293072 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 931/1876] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:08.366301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46133-df18-481a-8794-444e208df455 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.366573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46133-df18-481a-8794-444e208df455 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.366843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b46133-df18-481a-8794-444e208df455 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.368242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 946/1877] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 20:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:00:08.373957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0051a-3261-4757-b0e3-cf7c6d636ef0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.374453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0051a-3261-4757-b0e3-cf7c6d636ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.374963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0051a-3261-4757-b0e3-cf7c6d636ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.400837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-47a0051a-3261-4757-b0e3-cf7c6d636ef0 None None] MFA Rules not processed for user `7157e60fb6fb4b84866ce59f051a9037`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:08.402129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-47a0051a-3261-4757-b0e3-cf7c6d636ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:08.458713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 932/1878] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 20:00:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:00:08.472441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46133-df18-481a-8794-444e208df455 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:08.475449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-96b46133-df18-481a-8794-444e208df455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:08.495752 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b46133-df18-481a-8794-444e208df455 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:08.503079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe92cb-abee-4db4-910e-c9bef8da1bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:08.503906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe92cb-abee-4db4-910e-c9bef8da1bbf service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.504286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe92cb-abee-4db4-910e-c9bef8da1bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.504569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe92cb-abee-4db4-910e-c9bef8da1bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.516396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe92cb-abee-4db4-910e-c9bef8da1bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:08.517866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe92cb-abee-4db4-910e-c9bef8da1bbf service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:08.526046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 947/1879] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:08.612891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bbe7-ae63-47a3-945c-853dff941ccf None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.613180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bbe7-ae63-47a3-945c-853dff941ccf None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.613631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bbe7-ae63-47a3-945c-853dff941ccf None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.615066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 933/1880] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 20:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:00:08.620941 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a413-6f24-4447-8a80-cd563b8fc70e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.621232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a413-6f24-4447-8a80-cd563b8fc70e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.621546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378a413-6f24-4447-8a80-cd563b8fc70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.644072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9378a413-6f24-4447-8a80-cd563b8fc70e None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:08.645315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9378a413-6f24-4447-8a80-cd563b8fc70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:08.655924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 948/1881] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 20:00:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:08.667137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252bbe7-ae63-47a3-945c-853dff941ccf None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:08.678976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252bbe7-ae63-47a3-945c-853dff941ccf None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:08.682752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a954d7b-2ce7-45e6-af89-d9a1aae0c975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:08.683336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954d7b-2ce7-45e6-af89-d9a1aae0c975 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:08.683631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954d7b-2ce7-45e6-af89-d9a1aae0c975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:08.683902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a954d7b-2ce7-45e6-af89-d9a1aae0c975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:08.694587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a954d7b-2ce7-45e6-af89-d9a1aae0c975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:08.696022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a954d7b-2ce7-45e6-af89-d9a1aae0c975 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:08.706943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 934/1882] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:10.264162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a413-6f24-4447-8a80-cd563b8fc70e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:10.328708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378a413-6f24-4447-8a80-cd563b8fc70e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:10.334018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:10.334677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:10.334989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:10.335261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] PATH_INFO: `/v3/users/2f9118f115ab4503b9edc558089cba6a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:10.336432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f9118f115ab4503b9edc558089cba6a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:10.338486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:10.393254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f9118f115ab4503b9edc558089cba6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:10.393858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f9118f115ab4503b9edc558089cba6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:10.394452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f9118f115ab4503b9edc558089cba6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:10.407532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f9118f115ab4503b9edc558089cba6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:10.414896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f9118f115ab4503b9edc558089cba6a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:10.416658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:10.429929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 949/1883] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:10 2022] DELETE /identity/v3/users/2f9118f115ab4503b9edc558089cba6a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:10.434806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:10.435278 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:10.435788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:10.456382 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:10.457632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:10.518071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 935/1884] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:10.528136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:10.529610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:10.590200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b4f38-eb18-4999-a732-538f15e6ac6c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:10.594363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a2e84-d45e-4f36-abbe-2ae003a89632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:10.594984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2e84-d45e-4f36-abbe-2ae003a89632 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:10.595284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2e84-d45e-4f36-abbe-2ae003a89632 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:10.595549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a2e84-d45e-4f36-abbe-2ae003a89632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:10.606320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a2e84-d45e-4f36-abbe-2ae003a89632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:10.607954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a2e84-d45e-4f36-abbe-2ae003a89632 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:10.617925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 950/1885] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:10.895099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:10.896559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:10.911244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23244b26-96f4-474d-aa25-8869cc45376c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:10.917030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:10.917764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:10.918009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:10.918276 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] PATH_INFO: `/v3/projects/0669c30f17b54c61968e21a739d07407` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:10.919543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0669c30f17b54c61968e21a739d07407)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:10.921509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:10.962538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:10.972700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0669c30f17b54c61968e21a739d07407', 'request_id': 'req-197b1661-dd27-4be0-a9e1-81fc510d9385'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:10.979183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0669c30f17b54c61968e21a739d07407', 'request_id': 'req-197b1661-dd27-4be0-a9e1-81fc510d9385'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:10.985137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0669c30f17b54c61968e21a739d07407', 'request_id': 'req-197b1661-dd27-4be0-a9e1-81fc510d9385'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:11.002579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] The token cache is being invalidate because project 0669c30f17b54c61968e21a739d07407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:11.002862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:11.003571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-197b1661-dd27-4be0-a9e1-81fc510d9385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:11.005203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 936/1886] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:10 2022] DELETE /identity/v3/projects/0669c30f17b54c61968e21a739d07407 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:11.010235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678bf6-dc2d-4d15-a5ee-181f08c29f06 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.010531 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678bf6-dc2d-4d15-a5ee-181f08c29f06 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.010796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25678bf6-dc2d-4d15-a5ee-181f08c29f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.030583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-25678bf6-dc2d-4d15-a5ee-181f08c29f06 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:11.031791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-25678bf6-dc2d-4d15-a5ee-181f08c29f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:11.094316 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 951/1887] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:11.104368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e845-8802-4df6-bc71-d51ac8f62e58 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.104723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e845-8802-4df6-bc71-d51ac8f62e58 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.105078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6e845-8802-4df6-bc71-d51ac8f62e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.131856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a7c6e845-8802-4df6-bc71-d51ac8f62e58 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:11.132671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a7c6e845-8802-4df6-bc71-d51ac8f62e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:11.142469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 937/1888] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:11.146926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25678bf6-dc2d-4d15-a5ee-181f08c29f06 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:11.156813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25678bf6-dc2d-4d15-a5ee-181f08c29f06 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:11.161727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:11.162333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.162593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.162867 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.163520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:00:11.163824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:11.165580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:11.177698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 952/1889] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:00:11.190174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6e845-8802-4df6-bc71-d51ac8f62e58 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:11.201635 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6e845-8802-4df6-bc71-d51ac8f62e58 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:11.206621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:11.207353 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.207503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.207774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.208451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:11.210393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:11.241156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 938/1890] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:00:11 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:00:11.244211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:11.257155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e29373-76f3-4a78-9c38-7259e97d5d14 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:11.320095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:11.320756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.320986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.321259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.321929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:11.323881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:11.346733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 953/1891] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:00:11 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:00:11.351161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:11.361637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc41dd2-89bd-4a5b-a08b-a3e3379d11bf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:11.366336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:11.366937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.367213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.367484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.368119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:11.369745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:11.380128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 939/1892] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:00:11.384456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:11.394232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51057c93-c648-4fc3-a5d7-89949973685b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:11.402403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ef55e-61c8-405b-b957-3c86498e7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:11.403123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ef55e-61c8-405b-b957-3c86498e7145 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.403396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ef55e-61c8-405b-b957-3c86498e7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.404226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ef55e-61c8-405b-b957-3c86498e7145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.404496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ef55e-61c8-405b-b957-3c86498e7145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:11.406186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ef55e-61c8-405b-b957-3c86498e7145 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:11.412298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:11.418016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 954/1893] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:00:11.422569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:11.440068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea7bfe-7a8c-4721-b08e-b057e00a87b6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:11.449301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:11.450012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.450291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.450573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] PATH_INFO: `/v3/projects/1d3d02f55b0f4acea35f8b9b25294a5e/users/a3c5b51b0a2f4cb0aa0f19fa3ab306fc/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.467229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3d02f55b0f4acea35f8b9b25294a5e, user_id=a3c5b51b0a2f4cb0aa0f19fa3ab306fc, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:11.469915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:11.486625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 940/1894] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:00:11 2022] PUT /identity/v3/projects/1d3d02f55b0f4acea35f8b9b25294a5e/users/a3c5b51b0a2f4cb0aa0f19fa3ab306fc/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:11.497359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e80a-4ad9-4f9b-a519-d6ec68c90d4c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.497629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e80a-4ad9-4f9b-a519-d6ec68c90d4c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.497905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e80a-4ad9-4f9b-a519-d6ec68c90d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.528356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-dd25e80a-4ad9-4f9b-a519-d6ec68c90d4c None None] MFA Rules not processed for user `a3c5b51b0a2f4cb0aa0f19fa3ab306fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:11.529716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dd25e80a-4ad9-4f9b-a519-d6ec68c90d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:11.597782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 955/1895] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:00:11.616633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:11.618714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:11.684897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f7ddd-646a-43ea-8b12-aca18b11908d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:11.688919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:11.689594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:11.689869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:11.690141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:11.699384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:11.700835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:11.710024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 941/1896] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:13.794847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417823-2030-450b-aea3-438dc7be84dd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:13.795347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417823-2030-450b-aea3-438dc7be84dd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:13.795438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417823-2030-450b-aea3-438dc7be84dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:13.815589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5c417823-2030-450b-aea3-438dc7be84dd None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:13.816819 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5c417823-2030-450b-aea3-438dc7be84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:13.876762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 956/1897] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:00:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:13.888981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:13.890435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:13.967090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:13.970184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5c2b2-3366-47dd-a279-7fdb0204ba0c service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:13.976615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:13.977180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:13.977701 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:13.979666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:13.988568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:13.990199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:13.998979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 942/1898] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:00:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:00:15.784709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc95c4-095a-4269-bff6-98774eeb6a96 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:15.785591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc95c4-095a-4269-bff6-98774eeb6a96 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:15.786151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc95c4-095a-4269-bff6-98774eeb6a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:15.814655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8efc95c4-095a-4269-bff6-98774eeb6a96 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:15.816410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8efc95c4-095a-4269-bff6-98774eeb6a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:15.836390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 957/1899] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:00:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:15.857106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:15.868553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2fea8-4a02-4332-acbc-e03795e15563 service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:15.873982 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7937554-fd2e-449a-bee9-deecd3c994ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:15.875030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937554-fd2e-449a-bee9-deecd3c994ce service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:15.875667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937554-fd2e-449a-bee9-deecd3c994ce service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:15.875963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937554-fd2e-449a-bee9-deecd3c994ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:15.886830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7937554-fd2e-449a-bee9-deecd3c994ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:15.888433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7937554-fd2e-449a-bee9-deecd3c994ce service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:15.897494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 943/1900] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:00:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:00:23.208121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc95c4-095a-4269-bff6-98774eeb6a96 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:23.329871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc95c4-095a-4269-bff6-98774eeb6a96 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:23.334877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:23.335567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:23.335929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:23.336469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] PATH_INFO: `/v3/users/a3c5b51b0a2f4cb0aa0f19fa3ab306fc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:23.337962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c5b51b0a2f4cb0aa0f19fa3ab306fc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:23.354698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:23.420090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:23.444114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c5b51b0a2f4cb0aa0f19fa3ab306fc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.445146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c5b51b0a2f4cb0aa0f19fa3ab306fc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.446205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c5b51b0a2f4cb0aa0f19fa3ab306fc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.470268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c5b51b0a2f4cb0aa0f19fa3ab306fc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.479322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c5b51b0a2f4cb0aa0f19fa3ab306fc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:23.512841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 958/1901] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:23 2022] DELETE /identity/v3/users/a3c5b51b0a2f4cb0aa0f19fa3ab306fc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:23.517566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:23.518172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:23.518309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:23.556269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:23.559439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:23.677358 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 944/1902] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:23.748460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:23.750409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:23.870469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0228c-6d78-4bfb-abff-8f5aea1e7418 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:23.874155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff65ed-f423-41a2-ba3b-be95bb10c376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:23.875376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff65ed-f423-41a2-ba3b-be95bb10c376 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:23.875702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff65ed-f423-41a2-ba3b-be95bb10c376 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:23.875970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff65ed-f423-41a2-ba3b-be95bb10c376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:23.886831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff65ed-f423-41a2-ba3b-be95bb10c376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:23.888267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff65ed-f423-41a2-ba3b-be95bb10c376 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:23.918447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 959/1903] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:24.341957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:24.343426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:24.366528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e425591-d28c-4116-82f6-8b810a87e0a1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:24.386212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:24.386892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:24.387202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:24.387970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] PATH_INFO: `/v3/projects/1d3d02f55b0f4acea35f8b9b25294a5e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:24.388672 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3d02f55b0f4acea35f8b9b25294a5e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:24.390708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:24.495201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3d02f55b0f4acea35f8b9b25294a5e', 'request_id': 'req-0deec804-a434-4954-a7e4-56d8498998b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.503276 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3d02f55b0f4acea35f8b9b25294a5e', 'request_id': 'req-0deec804-a434-4954-a7e4-56d8498998b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.525104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3d02f55b0f4acea35f8b9b25294a5e', 'request_id': 'req-0deec804-a434-4954-a7e4-56d8498998b8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.552126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] The token cache is being invalidate because project 1d3d02f55b0f4acea35f8b9b25294a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:24.552998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.554340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:24.559457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 945/1904] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:24 2022] DELETE /identity/v3/projects/1d3d02f55b0f4acea35f8b9b25294a5e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:33.347553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:33.348098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:33.348223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:33.368357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:33.370217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:33.428886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 960/1905] 10.222.0.52 () {58 vars in 967 bytes} [Fri Oct 28 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:33.442302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:33.443958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:33.512402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:33.516993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deec804-a434-4954-a7e4-56d8498998b8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:33.523011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de3b22-20b9-4945-a70e-5ecf18cc5a55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:33.523682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de3b22-20b9-4945-a70e-5ecf18cc5a55 service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:33.525758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de3b22-20b9-4945-a70e-5ecf18cc5a55 service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:33.526162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de3b22-20b9-4945-a70e-5ecf18cc5a55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:33.535201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de3b22-20b9-4945-a70e-5ecf18cc5a55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:33.537822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de3b22-20b9-4945-a70e-5ecf18cc5a55 service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:33.550631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 946/1906] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:00:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:00:33.553849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:33.555302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:33.616023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:33.635154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee926ff-452f-4871-be06-3a32b058d495 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:33.640988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:33.641866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:33.642144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:33.642424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:33.646882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:33.664533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:33.666237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:33.678163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 961/1907] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:33.828591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cb668-6709-4477-8854-67a56e62614d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:33.828976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cb668-6709-4477-8854-67a56e62614d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:33.829399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cb668-6709-4477-8854-67a56e62614d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:33.851155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-099cb668-6709-4477-8854-67a56e62614d None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:33.852538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-099cb668-6709-4477-8854-67a56e62614d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:33.860774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 947/1908] 10.222.0.52 () {58 vars in 967 bytes} [Fri Oct 28 20:00:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:33.874090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:33.886820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffad39-c250-409e-815e-df55e324a5e4 service placement] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:33.892475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22128d43-2e80-479f-88af-1ef76b94808c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:33.893149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128d43-2e80-479f-88af-1ef76b94808c service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:33.893526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128d43-2e80-479f-88af-1ef76b94808c service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:33.893917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22128d43-2e80-479f-88af-1ef76b94808c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:33.902572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22128d43-2e80-479f-88af-1ef76b94808c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:33.904251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22128d43-2e80-479f-88af-1ef76b94808c service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:33.912799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 962/1909] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:00:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:00:35.606719 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b5fd-d51c-406a-a656-79c6314b8a3f None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:35.607302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b5fd-d51c-406a-a656-79c6314b8a3f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:35.607302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27b5fd-d51c-406a-a656-79c6314b8a3f None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:35.608658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 948/1910] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 20:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:00:35.619067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:35.619548 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:35.619637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:35.642592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] MFA Rules not processed for user `762f6a1257db4dde93c6aaf2d02ca73d`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:35.643926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:35.653843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 963/1911] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 20:00:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:35.674692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27b5fd-d51c-406a-a656-79c6314b8a3f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:35.678081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8e27b5fd-d51c-406a-a656-79c6314b8a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:35.697749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27b5fd-d51c-406a-a656-79c6314b8a3f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:35.703201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:35.703858 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:35.704134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:35.704445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:35.705597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:35.707502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:35.714006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:35.715990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:35.728398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 949/1912] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:35.801111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d115ac64-17dc-4f63-ac78-1468223ff548 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:35.805479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:35.806116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:35.806388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:35.806656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] PATH_INFO: `/v3/users/980babf1bead4d6ea38714377eea9d99` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:35.807789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=980babf1bead4d6ea38714377eea9d99)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:35.809733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:35.864978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980babf1bead4d6ea38714377eea9d99'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:35.865675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980babf1bead4d6ea38714377eea9d99'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:35.866293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980babf1bead4d6ea38714377eea9d99'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:35.882668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980babf1bead4d6ea38714377eea9d99'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:35.889517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-55e98bd0-a27e-4f42-abe5-cdf4ea26c8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980babf1bead4d6ea38714377eea9d99'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:35.907714 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 964/1913] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:00:35 2022] DELETE /identity/v3/users/980babf1bead4d6ea38714377eea9d99 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:00:36.099030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.109788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfdabf8-c871-4f58-82da-065903bf26a2 service placement] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.169889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.170525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.170790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.171102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] PATH_INFO: `/v3/projects/a66a453b660a4f099920d147b98aec6d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.172260 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66a453b660a4f099920d147b98aec6d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.174197 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.229965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66a453b660a4f099920d147b98aec6d', 'request_id': 'req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:36.236433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66a453b660a4f099920d147b98aec6d', 'request_id': 'req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:36.242681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66a453b660a4f099920d147b98aec6d', 'request_id': 'req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:36.258834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] The token cache is being invalidate because project a66a453b660a4f099920d147b98aec6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:00:36.259117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:36.259741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cc1c2235-9b7c-4c03-8d97-2314fa5eac74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:00:36.261248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 950/1914] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:00:36 2022] DELETE /identity/v3/projects/a66a453b660a4f099920d147b98aec6d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:36.266420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612be78-17e4-401b-993f-80bb05fd74f8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.266702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612be78-17e4-401b-993f-80bb05fd74f8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.266973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612be78-17e4-401b-993f-80bb05fd74f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.286724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c612be78-17e4-401b-993f-80bb05fd74f8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:36.287919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c612be78-17e4-401b-993f-80bb05fd74f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:36.337010 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:36.362786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 965/1915] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:36.370714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb563f-e633-4fe5-b17f-ea384f16ce68 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.370999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb563f-e633-4fe5-b17f-ea384f16ce68 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.371261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb563f-e633-4fe5-b17f-ea384f16ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.394376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d8cb563f-e633-4fe5-b17f-ea384f16ce68 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:36.395594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d8cb563f-e633-4fe5-b17f-ea384f16ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:36.408071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 951/1916] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:36.412809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612be78-17e4-401b-993f-80bb05fd74f8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.424556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612be78-17e4-401b-993f-80bb05fd74f8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.430044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.430640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.430927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.431202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.431851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:00:36.432151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.433815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.445722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 966/1917] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:00:36.450302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb563f-e633-4fe5-b17f-ea384f16ce68 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.461844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb563f-e633-4fe5-b17f-ea384f16ce68 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.470223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.471184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.471603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.472004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.473087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.476055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.514414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 952/1918] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:00:36 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:00:36.519708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.530150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be910e5-40e7-4a5e-b31d-3ec359bf175d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.592746 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.593263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.593569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.593841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.594475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.596412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.618889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 967/1919] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:00:36 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:00:36.623133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.634267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11379c-fd33-4124-a46c-f88f2165eca4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.639695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.640301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.640582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.640854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.642118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.644834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.659028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 953/1920] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:00:36.663267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.674015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877e0f8-c823-4cd4-80e3-4de4eaee09d8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.679325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399e83d-48a9-4a1f-884a-26a2a3f52601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.679928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399e83d-48a9-4a1f-884a-26a2a3f52601 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.680213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399e83d-48a9-4a1f-884a-26a2a3f52601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.680503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399e83d-48a9-4a1f-884a-26a2a3f52601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.681130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399e83d-48a9-4a1f-884a-26a2a3f52601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.682781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399e83d-48a9-4a1f-884a-26a2a3f52601 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.693559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 968/1921] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:00:36.698045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.708216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3af627-cb87-4a81-ba0a-b5d7483b4027 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.712926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.713598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.713877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.714145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] PATH_INFO: `/v3/projects/b9dab49ef00c4bb0bc1c27bc18a4f440/users/1bd64fa1961a424b8195381366154e06/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.730511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9dab49ef00c4bb0bc1c27bc18a4f440, user_id=1bd64fa1961a424b8195381366154e06, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.733221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.743753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:36.750354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 954/1922] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:00:36 2022] PUT /identity/v3/projects/b9dab49ef00c4bb0bc1c27bc18a4f440/users/1bd64fa1961a424b8195381366154e06/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:00:36.756287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d96c-8de9-4be0-a065-86f1cb85d03d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.756569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d96c-8de9-4be0-a065-86f1cb85d03d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.756842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1d96c-8de9-4be0-a065-86f1cb85d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.776786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-05d1d96c-8de9-4be0-a065-86f1cb85d03d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:36.778028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-05d1d96c-8de9-4be0-a065-86f1cb85d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:36.839417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 969/1923] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:36.849615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:36.851482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:36.911642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600255f7-e3e8-4611-b6d3-304a0d18deeb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:36.916086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:36.916694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:36.916999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:36.917249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:36.927160 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:36.928595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:36.938741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 955/1924] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:37.603828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc13a4-ba4f-467f-b782-5f90c8b5e1dd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:37.604152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc13a4-ba4f-467f-b782-5f90c8b5e1dd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:37.604442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc13a4-ba4f-467f-b782-5f90c8b5e1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:37.634431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-91fc13a4-ba4f-467f-b782-5f90c8b5e1dd None None] MFA Rules not processed for user `1bd64fa1961a424b8195381366154e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:37.635644 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-91fc13a4-ba4f-467f-b782-5f90c8b5e1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:37.677020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:37.710293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 970/1925] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:00:37.722664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:00:37.724212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:37.784441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c628ee-426c-4214-8bee-ed5a7230f624 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:00:37.788081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174122b7-e7dd-4de7-ae6c-da6a5f9e4c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:00:37.788687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174122b7-e7dd-4de7-ae6c-da6a5f9e4c94 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:37.788952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174122b7-e7dd-4de7-ae6c-da6a5f9e4c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:37.789223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174122b7-e7dd-4de7-ae6c-da6a5f9e4c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:37.798119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174122b7-e7dd-4de7-ae6c-da6a5f9e4c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:00:37.799611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174122b7-e7dd-4de7-ae6c-da6a5f9e4c94 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:00:37.808916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 956/1926] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:00:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:00:39.192493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc96d-bee6-462f-9065-a1f0a02d180c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:00:39.193068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc96d-bee6-462f-9065-a1f0a02d180c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:00:39.193068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbbc96d-bee6-462f-9065-a1f0a02d180c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:00:39.212838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1dbbc96d-bee6-462f-9065-a1f0a02d180c None None] MFA Rules not processed for user `1bd64fa1961a424b8195381366154e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:00:39.214046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1dbbc96d-bee6-462f-9065-a1f0a02d180c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:00:39.221266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 971/1927] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:00:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:00:47.804797 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=53 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:00:49.207803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=12 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:01:09.004125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:09.004696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:09.004696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:09.024349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] MFA Rules not processed for user `d4967aae8aa544d0b3da824976e0d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:09.025591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:09.092387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 957/1928] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:01:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:09.166443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913239c-4431-46b7-8167-2fc7612331bc None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:09.167006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913239c-4431-46b7-8167-2fc7612331bc None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:09.167006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913239c-4431-46b7-8167-2fc7612331bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:09.190958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c913239c-4431-46b7-8167-2fc7612331bc None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:09.192166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c913239c-4431-46b7-8167-2fc7612331bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:09.201475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 972/1929] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:09.223000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:01:09.224215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:09.303144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ce471-87c7-4eb9-8d13-bc7aa82dccfc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:01:09.308890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:01:09.309536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:09.309814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:09.310086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:09.319161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:01:09.320753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:01:09.330948 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 958/1930] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:01:12.293884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470dd1-fc57-46f3-a394-eea4e77c56a1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:12.294564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470dd1-fc57-46f3-a394-eea4e77c56a1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:12.294564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97470dd1-fc57-46f3-a394-eea4e77c56a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:12.321167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-97470dd1-fc57-46f3-a394-eea4e77c56a1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:12.331084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-97470dd1-fc57-46f3-a394-eea4e77c56a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:12.341588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 973/1931] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:12.362630 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:01:12.379396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b8285-5f72-4fad-89a7-7389f76820bd service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:01:12.385809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:01:12.386523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:12.386877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:12.387220 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:12.396645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:01:12.398542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:01:12.410499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 959/1932] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:01:16.576189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c2946-b4c4-448a-a386-3f394c150f7d None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:16.576799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c2946-b4c4-448a-a386-3f394c150f7d None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:16.576799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c2946-b4c4-448a-a386-3f394c150f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:16.606131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-368c2946-b4c4-448a-a386-3f394c150f7d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:16.607344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-368c2946-b4c4-448a-a386-3f394c150f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:16.616312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 974/1933] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:16.645748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:01:16.656918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ece51-6dd0-40b4-940c-e2576a311292 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:01:16.662670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620b42-725f-40a7-afc0-216721ccfd51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:01:16.663306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620b42-725f-40a7-afc0-216721ccfd51 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:16.663555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620b42-725f-40a7-afc0-216721ccfd51 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:16.663854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620b42-725f-40a7-afc0-216721ccfd51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:16.673086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620b42-725f-40a7-afc0-216721ccfd51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:01:16.674709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620b42-725f-40a7-afc0-216721ccfd51 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:01:16.685796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 960/1934] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:01:17.475882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:17.476169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:17.476442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:17.500479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] MFA Rules not processed for user `df9070301e814527a887aee5c266226f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:17.502256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:17.561555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 975/1935] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:01:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:19.655878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c927-5a60-4493-9a85-63e04eeb3e0c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:19.656446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c927-5a60-4493-9a85-63e04eeb3e0c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:19.656446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6c927-5a60-4493-9a85-63e04eeb3e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:19.677501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f6e6c927-5a60-4493-9a85-63e04eeb3e0c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:19.678734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f6e6c927-5a60-4493-9a85-63e04eeb3e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:19.688317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 961/1936] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:19.709533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:01:19.711256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:19.727783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e85cc4-2266-438b-bc07-c2c872b41b80 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:01:19.733609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:01:19.734286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:19.734631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:19.734989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:19.743765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:01:19.745543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:01:19.756125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 976/1937] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:01:23.885689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5477-8279-4d91-a06a-20f895f046af None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:23.886255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5477-8279-4d91-a06a-20f895f046af None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:23.886255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f5477-8279-4d91-a06a-20f895f046af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:23.917929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-897f5477-8279-4d91-a06a-20f895f046af None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:23.920429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-897f5477-8279-4d91-a06a-20f895f046af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:23.939962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 962/1938] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:24.036591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:01:24.053092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166169a-0184-426c-830a-8ecf49e50ad7 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:01:24.060024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:01:24.060969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:24.061307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:24.061820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:24.071593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:01:24.073301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:01:24.083768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 977/1939] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:01:28.088109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056238-222e-4dcc-a762-f22030a56689 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:28.088587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056238-222e-4dcc-a762-f22030a56689 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:28.088587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3056238-222e-4dcc-a762-f22030a56689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:28.113247 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a3056238-222e-4dcc-a762-f22030a56689 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:28.114712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a3056238-222e-4dcc-a762-f22030a56689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:28.126499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 963/1940] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:01:28.142806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:01:28.156103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff20195-88c2-460f-88cd-4468ec8afab2 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:01:28.162572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac543965-2ff6-4e51-9481-c8adb25ef2e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:01:28.163206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543965-2ff6-4e51-9481-c8adb25ef2e6 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:28.163485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543965-2ff6-4e51-9481-c8adb25ef2e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:28.163763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac543965-2ff6-4e51-9481-c8adb25ef2e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:28.173196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac543965-2ff6-4e51-9481-c8adb25ef2e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:01:28.174875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac543965-2ff6-4e51-9481-c8adb25ef2e6 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:01:28.185955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 978/1941] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:01:38.107988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=80 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:01:38.180827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=52 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:01:43.811871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b44-4e40-4916-ab51-9ad9180bce09 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:43.812381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b44-4e40-4916-ab51-9ad9180bce09 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:43.812381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b44-4e40-4916-ab51-9ad9180bce09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:43.832570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6a884b44-4e40-4916-ab51-9ad9180bce09 None None] MFA Rules not processed for user `463a0804f17940e4816ab7d984e52a74`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:43.833799 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6a884b44-4e40-4916-ab51-9ad9180bce09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:43.894120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 964/1942] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:01:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:46.823321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269f4f-84d3-4a51-9ccb-ee3e027c36e3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:01:46.823886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269f4f-84d3-4a51-9ccb-ee3e027c36e3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:01:46.824006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4269f4f-84d3-4a51-9ccb-ee3e027c36e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:01:46.846295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e4269f4f-84d3-4a51-9ccb-ee3e027c36e3 None None] MFA Rules not processed for user `1bd64fa1961a424b8195381366154e06`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:01:46.847501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e4269f4f-84d3-4a51-9ccb-ee3e027c36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:01:46.854785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 979/1943] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:01:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:01:53.887371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=25 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:01:56.839678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:02.331041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b4f6-9933-4c2f-a332-c7d88e24d308 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:02.331652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b4f6-9933-4c2f-a332-c7d88e24d308 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:02.331652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b4f6-9933-4c2f-a332-c7d88e24d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:02.353759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5bd1b4f6-9933-4c2f-a332-c7d88e24d308 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:02.354985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5bd1b4f6-9933-4c2f-a332-c7d88e24d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:02.364610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 965/1944] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:02:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:02.385601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4269f4f-84d3-4a51-9ccb-ee3e027c36e3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:02.409869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4269f4f-84d3-4a51-9ccb-ee3e027c36e3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:02.413552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10885a6a-1481-4afd-b70f-6c33e6ff2a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:02.414267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885a6a-1481-4afd-b70f-6c33e6ff2a2e service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:02.414608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885a6a-1481-4afd-b70f-6c33e6ff2a2e service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:02.414883 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10885a6a-1481-4afd-b70f-6c33e6ff2a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:02.424009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885a6a-1481-4afd-b70f-6c33e6ff2a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:02.425703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10885a6a-1481-4afd-b70f-6c33e6ff2a2e service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:02.436218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 980/1945] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:03.750711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4c1c3-74b8-426b-8262-de976667be1d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:03.751285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4c1c3-74b8-426b-8262-de976667be1d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:03.751285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4c1c3-74b8-426b-8262-de976667be1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:03.772525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ccb4c1c3-74b8-426b-8262-de976667be1d None None] MFA Rules not processed for user `e2da9a7ca37b4010a65e088515adcc57`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:03.773787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ccb4c1c3-74b8-426b-8262-de976667be1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:03.831059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 966/1946] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:05.648140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654feb39-2e02-42f0-8033-22693899e305 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:05.648716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654feb39-2e02-42f0-8033-22693899e305 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:05.648716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654feb39-2e02-42f0-8033-22693899e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:05.670755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-654feb39-2e02-42f0-8033-22693899e305 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:05.671959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-654feb39-2e02-42f0-8033-22693899e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:05.680696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 981/1947] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:05.696109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4c1c3-74b8-426b-8262-de976667be1d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:05.709711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4c1c3-74b8-426b-8262-de976667be1d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:05.718154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:05.718792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:05.719073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:05.719344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:05.728664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:05.730293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:05.740535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 967/1948] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:08.713983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfae65-b119-43b9-b530-62e1de908e8f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:08.714482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfae65-b119-43b9-b530-62e1de908e8f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:08.715205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfae65-b119-43b9-b530-62e1de908e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:08.738453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0fcfae65-b119-43b9-b530-62e1de908e8f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:08.739751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0fcfae65-b119-43b9-b530-62e1de908e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:08.749282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 982/1949] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:08.765092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:08.776202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899a168-845c-4bbd-9487-63549d8c2aeb service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:08.781892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:08.782566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:08.782842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:08.783112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:08.791728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:08.793284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:08.803784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 968/1950] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:17.054560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa8341-68f6-4b16-a385-e75dfdd951fe None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:17.055095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa8341-68f6-4b16-a385-e75dfdd951fe None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:17.055247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa8341-68f6-4b16-a385-e75dfdd951fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:17.075655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-62aa8341-68f6-4b16-a385-e75dfdd951fe None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:17.076869 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-62aa8341-68f6-4b16-a385-e75dfdd951fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:17.085365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 983/1951] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:17.101225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:17.112933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620051c-a740-456f-9769-5428fbc1cc20 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:17.120410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:17.120911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:17.121172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:17.121494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:17.131049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:17.132758 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:17.151299 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 969/1952] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:20.249824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18648b-939d-49ec-875a-82416feab789 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:20.250487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18648b-939d-49ec-875a-82416feab789 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:20.250487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18648b-939d-49ec-875a-82416feab789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:20.272821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4b18648b-939d-49ec-875a-82416feab789 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:20.274160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4b18648b-939d-49ec-875a-82416feab789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:20.284563 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 984/1953] 10.222.0.65 () {58 vars in 1016 bytes} [Fri Oct 28 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:20.305317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:20.316651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339350e-39e7-4db9-b17d-04eefc8c8b74 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:20.323017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:20.323614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:20.323890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:20.324157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:20.332850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:20.334537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:20.343788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 970/1954] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:24.694423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18648b-939d-49ec-875a-82416feab789 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:24.695988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4b18648b-939d-49ec-875a-82416feab789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:24.709148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18648b-939d-49ec-875a-82416feab789 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:24.713528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:24.714128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:24.714403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:24.714709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:24.716454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:24.730741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:24.732187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:24.743935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 985/1955] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:24.917737 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:24.922875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=53 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:24.929365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d0e34-ce4b-40e6-8920-d99ea868b2d1 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:24.933815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:24.934419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:24.934717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:24.934993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:24.936761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:24.950292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:24.951743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:24.963203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 971/1956] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:34.738449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=24 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:34.957738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:37.224598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:37.242497 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1204e7-744d-4b38-a272-ca7cfa190d92 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:37.251154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:37.251901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:37.252194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:37.252453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:37.254436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:37.265413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:37.267028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:37.276371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 986/1957] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:39.564879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:39.584691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d73e61-6f01-4678-94cd-376ff2b094a4 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:39.594406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278237e-16e4-455d-b10f-1b4574e5eb26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:39.595004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278237e-16e4-455d-b10f-1b4574e5eb26 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:39.595285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278237e-16e4-455d-b10f-1b4574e5eb26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:39.595557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278237e-16e4-455d-b10f-1b4574e5eb26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:39.597359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1278237e-16e4-455d-b10f-1b4574e5eb26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:39.609849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278237e-16e4-455d-b10f-1b4574e5eb26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:39.611284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278237e-16e4-455d-b10f-1b4574e5eb26 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:39.621554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 972/1958] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:42.562933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:42.574693 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e03fbd-9f41-4c05-8728-b05cb03b6f1c service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:42.580776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:42.582160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:42.582646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:42.583006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:42.585418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:42.640029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:42.646123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:42.673691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 987/1959] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:02:43.147894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:43.148361 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:43.148516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:43.184586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] MFA Rules not processed for user `d4967aae8aa544d0b3da824976e0d9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:43.185865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:43.197019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 973/1960] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:44.139183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:44.140851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:44.241231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe98447-fe50-47b0-b957-854d65e04543 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:44.248950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:44.249636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:44.249984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:44.250299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:44.252160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:44.269939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:44.275204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:44.279584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:44.281289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:44.293175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cb04b-3414-4cb0-bb43-9967a5b43be8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:44.296167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 988/1961] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:44.313055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:44.313757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:44.314042 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:44.314315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] PATH_INFO: `/v3/users/df9070301e814527a887aee5c266226f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:44.315580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9070301e814527a887aee5c266226f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:44.317632 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:44.401655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9070301e814527a887aee5c266226f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.418946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9070301e814527a887aee5c266226f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.420559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9070301e814527a887aee5c266226f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.432739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9070301e814527a887aee5c266226f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.434308 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-724b910c-4d6c-4ea0-a65f-60d6b12bd52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9070301e814527a887aee5c266226f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.464003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 974/1962] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:02:44 2022] DELETE /identity/v3/users/df9070301e814527a887aee5c266226f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:44.712955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:44.733452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45ebd3-895a-4db5-a59e-9c4ea88431ce service placement] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:44.867241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:44.868360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:44.868534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:44.869171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] PATH_INFO: `/v3/projects/306741a419074ac294de16c60ff5cf57` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:44.870328 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=306741a419074ac294de16c60ff5cf57)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:44.872966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:44.948359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306741a419074ac294de16c60ff5cf57', 'request_id': 'req-2608912a-b4b6-4dbf-b285-6498a5524abf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.957641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306741a419074ac294de16c60ff5cf57', 'request_id': 'req-2608912a-b4b6-4dbf-b285-6498a5524abf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.967654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306741a419074ac294de16c60ff5cf57', 'request_id': 'req-2608912a-b4b6-4dbf-b285-6498a5524abf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.971708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:44.988294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] The token cache is being invalidate because project 306741a419074ac294de16c60ff5cf57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:02:44.989168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.990302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2608912a-b4b6-4dbf-b285-6498a5524abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:44.992319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 989/1963] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:02:44 2022] DELETE /identity/v3/projects/306741a419074ac294de16c60ff5cf57 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:45.012961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb9b1-b49f-4700-bb4e-1df2927f7833 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.013933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb9b1-b49f-4700-bb4e-1df2927f7833 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.014460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cb9b1-b49f-4700-bb4e-1df2927f7833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.046076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a22cb9b1-b49f-4700-bb4e-1df2927f7833 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:45.048184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a22cb9b1-b49f-4700-bb4e-1df2927f7833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:45.154676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 975/1964] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:45.166305 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236304-d88d-45c4-b27e-4dfbcd6ed368 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.167011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236304-d88d-45c4-b27e-4dfbcd6ed368 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.167149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4236304-d88d-45c4-b27e-4dfbcd6ed368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.202499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f4236304-d88d-45c4-b27e-4dfbcd6ed368 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:45.205252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f4236304-d88d-45c4-b27e-4dfbcd6ed368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:45.217873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 990/1965] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:45.222767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cb9b1-b49f-4700-bb4e-1df2927f7833 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:45.238959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cb9b1-b49f-4700-bb4e-1df2927f7833 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:45.244947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:45.245599 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.245874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.246139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.246783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:02:45.247083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:45.248681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:45.262464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 976/1966] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:02:45.267214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4236304-d88d-45c4-b27e-4dfbcd6ed368 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:45.278552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4236304-d88d-45c4-b27e-4dfbcd6ed368 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:45.288257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:45.289001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.289463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.289746 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.290462 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:45.294392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:45.335580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 991/1967] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:02:45 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:02:45.340088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:45.351930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3941b003-25cf-4058-b774-aaa29c7b4c73 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:45.400009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:45.421266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:45.421919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.422355 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.422634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.423272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:45.425201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:45.448331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 977/1968] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:02:45 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:02:45.452888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:45.463962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09feae9-1b3c-4d4c-b482-7705621096ea admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:45.469352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:45.469999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.470280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.470552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.471221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:45.472965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:45.485820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 992/1969] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:45.490486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:45.501759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7047b-d24b-44b5-8a52-253fb1a96a2a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:45.507533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a0a0f7-b860-43c0-a957-d4bf2e094f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:45.508154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0a0f7-b860-43c0-a957-d4bf2e094f55 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.508430 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0a0f7-b860-43c0-a957-d4bf2e094f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.508696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a0a0f7-b860-43c0-a957-d4bf2e094f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.509336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0a0f7-b860-43c0-a957-d4bf2e094f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:45.510995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a0a0f7-b860-43c0-a957-d4bf2e094f55 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:45.521694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 978/1970] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:45.526070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:45.536702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574af084-a9e0-436f-a8da-089bf2a832de admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:45.541620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:45.542291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.542562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.542833 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] PATH_INFO: `/v3/projects/4bbbeae9888e4d6bbabd05682cf44e14/users/2c911af16e8b40d78298ac44cd620e0a/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.558315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bbbeae9888e4d6bbabd05682cf44e14, user_id=2c911af16e8b40d78298ac44cd620e0a, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:45.560988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:45.575872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 993/1971] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:45 2022] PUT /identity/v3/projects/4bbbeae9888e4d6bbabd05682cf44e14/users/2c911af16e8b40d78298ac44cd620e0a/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:45.581119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0007f2-3bb5-4814-8d3b-d6179aad7f9d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.581425 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0007f2-3bb5-4814-8d3b-d6179aad7f9d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.581778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0007f2-3bb5-4814-8d3b-d6179aad7f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.602103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-9f0007f2-3bb5-4814-8d3b-d6179aad7f9d None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:45.603258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9f0007f2-3bb5-4814-8d3b-d6179aad7f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:45.682876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 979/1972] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:45.694078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:45.696184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:45.764071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1be69-147f-4632-aad1-ac0aac66963a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:45.768722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:45.769551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:45.769894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:45.770231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:45.781487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:45.783217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:45.794574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 994/1973] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:47.186137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d39b8-706e-4390-8d91-0ca514ca545f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.186724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d39b8-706e-4390-8d91-0ca514ca545f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.186960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d39b8-706e-4390-8d91-0ca514ca545f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.233360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-137d39b8-706e-4390-8d91-0ca514ca545f None None] MFA Rules not processed for user `2c911af16e8b40d78298ac44cd620e0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:47.235182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-137d39b8-706e-4390-8d91-0ca514ca545f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:47.359066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 980/1974] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:47.364318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:47.379207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abefc9cd-bf12-4c35-80fd-8897d5ebb929 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:47.388585 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:47.390014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.390506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.392635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.393617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:47.396633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:47.437679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 995/1975] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:02:47 2022] POST /identity/v3/projects => generated 405 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:02:47.442111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d39b8-706e-4390-8d91-0ca514ca545f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:47.458795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d39b8-706e-4390-8d91-0ca514ca545f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:47.520652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:47.538605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:47.558220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:47.604436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:47.605088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.605366 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.605667 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.606324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:47.612108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:47.672473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 981/1976] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:02:47 2022] POST /identity/v3/users => generated 309 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:02:47.677169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:47.692429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fb140-e69f-47b2-b7c4-0dfb0be19f57 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:47.697970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:47.698646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.698998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.699207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.699941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:47.701578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:47.725251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 982/1977] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:47.725764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:47.735812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3d88c-b72b-4bcb-a510-317dfb06df19 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:47.738988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d001f-9c62-489f-95b8-42ec6df5dbcf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:47.744819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:47.745600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.745975 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.746443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] PATH_INFO: `/v3/projects/79d95261f7084beeaf3248375a37a182/users/4b5e155874154699a10dc1c33dbe06ea/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.747295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:47.748434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.748806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.748980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.750825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:47.759131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:47.765097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d95261f7084beeaf3248375a37a182, user_id=4b5e155874154699a10dc1c33dbe06ea, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:47.767833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:47.786036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 983/1978] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:47 2022] PUT /identity/v3/projects/79d95261f7084beeaf3248375a37a182/users/4b5e155874154699a10dc1c33dbe06ea/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:47.789960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:47.827676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:47.829473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:47.852731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 996/1979] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:47.877246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc0fa1-1ef3-4c25-a288-1abdc9a90499 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:47.882068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e4850-d15a-4f9f-bfd7-0c976c6ce7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:47.882730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4850-d15a-4f9f-bfd7-0c976c6ce7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.882999 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4850-d15a-4f9f-bfd7-0c976c6ce7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.883271 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e4850-d15a-4f9f-bfd7-0c976c6ce7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.883939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e4850-d15a-4f9f-bfd7-0c976c6ce7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:47.885611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e4850-d15a-4f9f-bfd7-0c976c6ce7c6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:47.897843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 984/1980] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:02:47.902343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:47.915716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78287e-2690-446a-81dc-6675dbaaf450 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:47.920611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:47.921288 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:47.921600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:47.922113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] PATH_INFO: `/v3/projects/79d95261f7084beeaf3248375a37a182/users/4b5e155874154699a10dc1c33dbe06ea/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:47.923794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d95261f7084beeaf3248375a37a182, user_id=4b5e155874154699a10dc1c33dbe06ea, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:47.926838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:47.939045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 997/1981] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:47 2022] PUT /identity/v3/projects/79d95261f7084beeaf3248375a37a182/users/4b5e155874154699a10dc1c33dbe06ea/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:48.782865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da34a-ce04-4422-81df-7d6584e21f62 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:48.783363 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da34a-ce04-4422-81df-7d6584e21f62 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:48.783489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684da34a-ce04-4422-81df-7d6584e21f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:48.825562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-684da34a-ce04-4422-81df-7d6584e21f62 None None] MFA Rules not processed for user `4b5e155874154699a10dc1c33dbe06ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:48.826973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-684da34a-ce04-4422-81df-7d6584e21f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:48.914089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 985/1982] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:50.193152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:50.275106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3716804-9538-44f4-aef7-f0c43315704b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:50.280389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:50.281040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:50.281314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:50.281619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] PATH_INFO: `/v3/users/2c911af16e8b40d78298ac44cd620e0a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:50.282790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c911af16e8b40d78298ac44cd620e0a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:50.284966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:50.396889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c911af16e8b40d78298ac44cd620e0a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.398308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c911af16e8b40d78298ac44cd620e0a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.398308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c911af16e8b40d78298ac44cd620e0a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.414510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c911af16e8b40d78298ac44cd620e0a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.423162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c911af16e8b40d78298ac44cd620e0a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.442207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 998/1983] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:02:50 2022] DELETE /identity/v3/users/2c911af16e8b40d78298ac44cd620e0a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:50.656731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da34a-ce04-4422-81df-7d6584e21f62 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:50.684346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684da34a-ce04-4422-81df-7d6584e21f62 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:50.727396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:50.770524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:50.771262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:50.771601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:50.772084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] PATH_INFO: `/v3/projects/4bbbeae9888e4d6bbabd05682cf44e14` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:50.773348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bbbeae9888e4d6bbabd05682cf44e14)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:50.775466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:50.843733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bbbeae9888e4d6bbabd05682cf44e14', 'request_id': 'req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.852297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bbbeae9888e4d6bbabd05682cf44e14', 'request_id': 'req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.861341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bbbeae9888e4d6bbabd05682cf44e14', 'request_id': 'req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.878511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] The token cache is being invalidate because project 4bbbeae9888e4d6bbabd05682cf44e14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:02:50.878988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.879961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:50.881822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 986/1984] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:02:50 2022] DELETE /identity/v3/projects/4bbbeae9888e4d6bbabd05682cf44e14 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:50.886162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:50.887800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:50.900795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c92c5-e2dd-4b63-b1d4-c490b729057b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:50.910710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:50.964921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:50.965611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:50.965885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:50.966151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] PATH_INFO: `/v3/users/4b5e155874154699a10dc1c33dbe06ea` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:50.967274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5e155874154699a10dc1c33dbe06ea)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:50.969198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.018951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5e155874154699a10dc1c33dbe06ea'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.019624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5e155874154699a10dc1c33dbe06ea'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.020237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5e155874154699a10dc1c33dbe06ea'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.032458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5e155874154699a10dc1c33dbe06ea'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.039392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6f5e9e6d-d212-4a04-bee4-772abdd297e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5e155874154699a10dc1c33dbe06ea'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.053497 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 999/1985] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:02:50 2022] DELETE /identity/v3/users/4b5e155874154699a10dc1c33dbe06ea => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:51.239452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:51.241213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:51.257255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb1d4-5d34-435f-bee6-2f92c2d8cd89 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:51.330512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:51.331621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.332061 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.332494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] PATH_INFO: `/v3/projects/79d95261f7084beeaf3248375a37a182` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.334283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d95261f7084beeaf3248375a37a182)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:51.337480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.394579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d95261f7084beeaf3248375a37a182', 'request_id': 'req-94faba11-dffe-4855-b3a6-ff10c42c5cde'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.401505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d95261f7084beeaf3248375a37a182', 'request_id': 'req-94faba11-dffe-4855-b3a6-ff10c42c5cde'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.403669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:51.409136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d95261f7084beeaf3248375a37a182', 'request_id': 'req-94faba11-dffe-4855-b3a6-ff10c42c5cde'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.425495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] The token cache is being invalidate because project 79d95261f7084beeaf3248375a37a182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:02:51.425786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.426542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-94faba11-dffe-4855-b3a6-ff10c42c5cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:51.428243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 987/1986] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:02:51 2022] DELETE /identity/v3/projects/79d95261f7084beeaf3248375a37a182 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:51.433292 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246538-622c-4d0c-a3df-fa3b9cef3b3b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.435350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246538-622c-4d0c-a3df-fa3b9cef3b3b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.435350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246538-622c-4d0c-a3df-fa3b9cef3b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.464464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6e246538-622c-4d0c-a3df-fa3b9cef3b3b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:51.466379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6e246538-622c-4d0c-a3df-fa3b9cef3b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:51.559442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1000/1987] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:51.569486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6916ae6-a2d7-412a-aaa8-4be1a72d9d1f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.569951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6916ae6-a2d7-412a-aaa8-4be1a72d9d1f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.570412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6916ae6-a2d7-412a-aaa8-4be1a72d9d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.596453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a6916ae6-a2d7-412a-aaa8-4be1a72d9d1f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:51.597935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a6916ae6-a2d7-412a-aaa8-4be1a72d9d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:51.613547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246538-622c-4d0c-a3df-fa3b9cef3b3b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:51.613778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 988/1988] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:51.624996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246538-622c-4d0c-a3df-fa3b9cef3b3b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:51.636192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:51.636944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.637082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.637403 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.638059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:02:51.638372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:51.640000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.658159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1001/1989] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:02:51.663915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6916ae6-a2d7-412a-aaa8-4be1a72d9d1f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:51.675435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6916ae6-a2d7-412a-aaa8-4be1a72d9d1f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:51.684424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:51.685234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.685601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.686421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.686648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:51.688660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.723311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 989/1990] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:02:51 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:02:51.727788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:51.739320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8c847-60a9-40d6-bca2-a0bbf5d8334f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:51.758934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:51.815254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:51.815930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.816210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.816481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.817117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:51.819138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.844826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1002/1991] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:02:51 2022] POST /identity/v3/users => generated 284 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:02:51.851285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:51.866458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765ef28-9d6a-4c0d-858f-306886007fe7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:51.872549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:51.873154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.873463 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.873747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.874392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:51.875992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.886609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 990/1992] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:51.893182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:51.904150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bb953-dd24-45c2-8f89-c2b84d411455 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:51.909885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9abe6-e888-491d-a0ad-63e3b5fbe7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:51.910521 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9abe6-e888-491d-a0ad-63e3b5fbe7eb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.910779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9abe6-e888-491d-a0ad-63e3b5fbe7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.911018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9abe6-e888-491d-a0ad-63e3b5fbe7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.911665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9abe6-e888-491d-a0ad-63e3b5fbe7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:51.913308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9abe6-e888-491d-a0ad-63e3b5fbe7eb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.925167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1003/1993] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:51.931460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:51.941938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c2ad05-a22f-4e25-91cd-39c8b61e4645 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:51.948519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:51.949717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.950202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:51.950692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] PATH_INFO: `/v3/projects/1bc0ca4da5e04ac5bd66c278feabaef0/users/db18489040ff4d369395efa12b32b5c3/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:51.969481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc0ca4da5e04ac5bd66c278feabaef0, user_id=db18489040ff4d369395efa12b32b5c3, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:51.972137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:51.987008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 991/1994] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:51 2022] PUT /identity/v3/projects/1bc0ca4da5e04ac5bd66c278feabaef0/users/db18489040ff4d369395efa12b32b5c3/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:51.999662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd90df-6fb7-416a-ba82-f768e62f3593 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:51.999953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd90df-6fb7-416a-ba82-f768e62f3593 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.000238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd90df-6fb7-416a-ba82-f768e62f3593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.031552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f2fd90df-6fb7-416a-ba82-f768e62f3593 None None] MFA Rules not processed for user `db18489040ff4d369395efa12b32b5c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:52.032762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f2fd90df-6fb7-416a-ba82-f768e62f3593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:52.106589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1004/1995] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:52.112562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.198888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717f4c7-d955-41aa-a9c4-5f59dafdbda7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.203904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.204992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.204992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.205205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.205738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.207710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:52.238616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 992/1996] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:02:52 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:02:52.243159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd90df-6fb7-416a-ba82-f768e62f3593 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.258491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd90df-6fb7-416a-ba82-f768e62f3593 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.326312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.326942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.327221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.327495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.328139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.330607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:52.363391 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1005/1997] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:02:52 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:02:52.368132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.378857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d92f6-79fb-4dc7-98c1-e9a9cc9f0ee8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.383846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.384560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.384912 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.385199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.385923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.387640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:52.399261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 993/1998] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:02:52.403516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.416194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d386f-3e1b-4d5d-b7e3-89ff8f7d9ecf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.421815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.422416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.422688 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.423110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] PATH_INFO: `/v3/projects/894810a145cb49b3929166093506a149/users/d9a261843d4c4b9db8f2d82e9e5ea4f9/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.441187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=894810a145cb49b3929166093506a149, user_id=d9a261843d4c4b9db8f2d82e9e5ea4f9, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.444033 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:52.446743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:52.462897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1006/1999] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:52 2022] PUT /identity/v3/projects/894810a145cb49b3929166093506a149/users/d9a261843d4c4b9db8f2d82e9e5ea4f9/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:52.467592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.482206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637db0-bbee-4773-856b-36b57a2d244c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.548505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:52.556871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707f0f3-e6bf-4718-afd5-b29398a0011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.557569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707f0f3-e6bf-4718-afd5-b29398a0011e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.557860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707f0f3-e6bf-4718-afd5-b29398a0011e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.558432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707f0f3-e6bf-4718-afd5-b29398a0011e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.559285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707f0f3-e6bf-4718-afd5-b29398a0011e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.561074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707f0f3-e6bf-4718-afd5-b29398a0011e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:52.571898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 994/2000] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:52.585195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.587353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba6fcc-fe75-4fc9-b551-30b7b4c79bce admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.592249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.592928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.593209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.593517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] PATH_INFO: `/v3/projects/894810a145cb49b3929166093506a149/users/d9a261843d4c4b9db8f2d82e9e5ea4f9/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.595461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=894810a145cb49b3929166093506a149, user_id=d9a261843d4c4b9db8f2d82e9e5ea4f9, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.598811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:52.614105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1007/2001] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:52 2022] PUT /identity/v3/projects/894810a145cb49b3929166093506a149/users/d9a261843d4c4b9db8f2d82e9e5ea4f9/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:52.624694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.624975 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.625245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.655958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] MFA Rules not processed for user `d9a261843d4c4b9db8f2d82e9e5ea4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:52.657342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:52.735710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 995/2002] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:52.747620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.749518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:52.817863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a319f-3d28-48e2-8721-e1c63e8cf8cf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.823691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.824614 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.824896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.825173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.838995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.841795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:52.861337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1008/2003] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:52.910422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:52.912044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:52.925489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032da24f-d171-4e46-b277-1497e76d9f95 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:52.930266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c8ce5-6031-49f4-ac65-40b70bd6fe48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:52.930938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c8ce5-6031-49f4-ac65-40b70bd6fe48 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:52.931311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c8ce5-6031-49f4-ac65-40b70bd6fe48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:52.931570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c8ce5-6031-49f4-ac65-40b70bd6fe48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:52.996512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c8ce5-6031-49f4-ac65-40b70bd6fe48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:52.998064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c8ce5-6031-49f4-ac65-40b70bd6fe48 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:53.009098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 996/2004] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:56.556028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:56.692823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb7278-b4be-4a83-82bf-f68e8701a874 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:56.697210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:56.698264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:56.698815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:56.699175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] PATH_INFO: `/v3/users/db18489040ff4d369395efa12b32b5c3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:56.700901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db18489040ff4d369395efa12b32b5c3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:56.703853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:56.790057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db18489040ff4d369395efa12b32b5c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.790641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db18489040ff4d369395efa12b32b5c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.791261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db18489040ff4d369395efa12b32b5c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.811879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db18489040ff4d369395efa12b32b5c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.822352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db18489040ff4d369395efa12b32b5c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:56.853312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1009/2005] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:02:56 2022] DELETE /identity/v3/users/db18489040ff4d369395efa12b32b5c3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:56.854634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:56.855640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:56.855919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:56.879982 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:56.882951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:56.964287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:56.965894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:56.968544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 997/2006] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:56.980341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:56.980916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:56.982978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:57.019392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:57.054129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6eed2-72b3-456e-bdd9-758e98ab5631 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:57.062392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:57.062991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:57.063464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:57.064792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:57.067758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:57.074018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c88c0-28c1-42c1-9512-0e2ba2343c83 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:57.081782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:57.082626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:57.083054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:57.083453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:57.086182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:57.087728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:57.094726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:57.096211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:57.096887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1010/2007] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:02:57.106707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 998/2008] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:02:57.623032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:57.624649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:57.652904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01050104-dc92-4de1-8b32-4e4732274836 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:57.658805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:57.659363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:57.659637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:57.659911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] PATH_INFO: `/v3/projects/1bc0ca4da5e04ac5bd66c278feabaef0` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:57.661044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc0ca4da5e04ac5bd66c278feabaef0)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:57.664871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:57.751064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc0ca4da5e04ac5bd66c278feabaef0', 'request_id': 'req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.759606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc0ca4da5e04ac5bd66c278feabaef0', 'request_id': 'req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.766331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc0ca4da5e04ac5bd66c278feabaef0', 'request_id': 'req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.785320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] The token cache is being invalidate because project 1bc0ca4da5e04ac5bd66c278feabaef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:02:57.785667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.786332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.792466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1011/2009] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:02:57 2022] DELETE /identity/v3/projects/1bc0ca4da5e04ac5bd66c278feabaef0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:57.793313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:57.806492 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589968-2dfc-4e2a-a4ed-c838b1e0bfdd service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:57.904275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:57.905231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:57.905547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:57.905820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] PATH_INFO: `/v3/users/d9a261843d4c4b9db8f2d82e9e5ea4f9` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:57.907174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9a261843d4c4b9db8f2d82e9e5ea4f9)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:57.909226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:57.968183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9a261843d4c4b9db8f2d82e9e5ea4f9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.983631 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9a261843d4c4b9db8f2d82e9e5ea4f9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.984521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9a261843d4c4b9db8f2d82e9e5ea4f9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.993676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9a261843d4c4b9db8f2d82e9e5ea4f9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:57.994501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-003385cd-812e-4c82-b42e-2028801f5590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9a261843d4c4b9db8f2d82e9e5ea4f9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:58.011406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 999/2010] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:02:57 2022] DELETE /identity/v3/users/d9a261843d4c4b9db8f2d82e9e5ea4f9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:58.311611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:58.313648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:58.327641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba35b0-ffb8-4288-84d4-fdbe2f8337ee admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:58.389184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:58.389781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.390053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.390323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] PATH_INFO: `/v3/projects/894810a145cb49b3929166093506a149` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.391516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=894810a145cb49b3929166093506a149)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:58.393424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:58.429286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:58.444735 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894810a145cb49b3929166093506a149', 'request_id': 'req-3eaaf19b-bf7c-444f-bd01-d132178057aa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:58.451248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894810a145cb49b3929166093506a149', 'request_id': 'req-3eaaf19b-bf7c-444f-bd01-d132178057aa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:58.457518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894810a145cb49b3929166093506a149', 'request_id': 'req-3eaaf19b-bf7c-444f-bd01-d132178057aa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:58.472363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] The token cache is being invalidate because project 894810a145cb49b3929166093506a149 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:02:58.472673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:58.473320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3eaaf19b-bf7c-444f-bd01-d132178057aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:02:58.475225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1012/2011] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:02:58 2022] DELETE /identity/v3/projects/894810a145cb49b3929166093506a149 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:58.480038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce814-ceaf-4642-bd7d-b2862076000e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.480319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce814-ceaf-4642-bd7d-b2862076000e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.480590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ce814-ceaf-4642-bd7d-b2862076000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.503847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-908ce814-ceaf-4642-bd7d-b2862076000e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:58.505106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-908ce814-ceaf-4642-bd7d-b2862076000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:58.541704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:58.574435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1000/2012] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:58.583061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655c9d-ac83-4b1e-8682-ffe505e1863f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.583315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655c9d-ac83-4b1e-8682-ffe505e1863f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.583582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0655c9d-ac83-4b1e-8682-ffe505e1863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.607550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c0655c9d-ac83-4b1e-8682-ffe505e1863f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:58.608793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c0655c9d-ac83-4b1e-8682-ffe505e1863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:58.618748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1013/2013] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:58.623582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ce814-ceaf-4642-bd7d-b2862076000e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:58.634193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ce814-ceaf-4642-bd7d-b2862076000e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:58.640450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:58.641032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.641315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.641697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.642390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:02:58.642714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:58.644503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:58.657528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1001/2014] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:02:58.662132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655c9d-ac83-4b1e-8682-ffe505e1863f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:58.671797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0655c9d-ac83-4b1e-8682-ffe505e1863f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:58.676798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:58.677429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.677712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.677982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.678644 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:58.680595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:58.712975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1014/2015] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:02:58 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:02:58.715074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:58.726344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91618a6d-f28b-40b5-9f98-ce1ed7e9981b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:58.799518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:58.800904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.801509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.801998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.803332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:58.807803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:58.836895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1002/2016] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:02:58 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:02:58.839357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:58.850684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe51b3d-6fd3-4d2e-9194-c7dcaf9b38cd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:58.855445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:58.856094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.856375 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.856647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.857297 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:58.858971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:58.875445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1015/2017] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:02:58.880531 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:58.893190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcfb41-5fb7-461c-8685-b6d92f996896 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:58.900925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17696dce-61da-4727-8671-9d919a1ac2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:58.901978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696dce-61da-4727-8671-9d919a1ac2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.902449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696dce-61da-4727-8671-9d919a1ac2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.902888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17696dce-61da-4727-8671-9d919a1ac2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.904046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17696dce-61da-4727-8671-9d919a1ac2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:58.907195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17696dce-61da-4727-8671-9d919a1ac2d9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:58.922311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1003/2018] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:58.926900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:58.939038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71810d-fefc-4da7-93cc-46d4a8ec4f84 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:58.945014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:58.945724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.946003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.946280 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] PATH_INFO: `/v3/projects/281cf9853f4a40ceb4c7d2532ab5bfae/users/6b54124732944b8d852f0fe1eca78946/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:58.963423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=281cf9853f4a40ceb4c7d2532ab5bfae, user_id=6b54124732944b8d852f0fe1eca78946, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:58.966163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:58.982830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1016/2019] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:58 2022] PUT /identity/v3/projects/281cf9853f4a40ceb4c7d2532ab5bfae/users/6b54124732944b8d852f0fe1eca78946/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:02:58.996925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ec6b-c6c4-4faf-98cb-a5b0e1fd0f46 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:58.997202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ec6b-c6c4-4faf-98cb-a5b0e1fd0f46 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:58.997723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2ec6b-c6c4-4faf-98cb-a5b0e1fd0f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.028846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-dcf2ec6b-c6c4-4faf-98cb-a5b0e1fd0f46 None None] MFA Rules not processed for user `6b54124732944b8d852f0fe1eca78946`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:59.030128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-dcf2ec6b-c6c4-4faf-98cb-a5b0e1fd0f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:59.107926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1004/2020] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:59.113636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.192523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca560e-20bf-4329-939b-198b8de8cb0a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.197994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.198769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.199116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.199420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.200294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.202379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.237490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1017/2021] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:02:59 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:02:59.242735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ec6b-c6c4-4faf-98cb-a5b0e1fd0f46 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.253910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2ec6b-c6c4-4faf-98cb-a5b0e1fd0f46 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.285159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:59.323506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.324125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.324397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.324669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.325322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.327412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.351294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1005/2022] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:02:59 2022] POST /identity/v3/users => generated 307 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:02:59.355536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.368200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944c60-96da-45a4-9f9e-9c4a85e2f581 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.374021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.374695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.374977 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.375250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.375909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.377626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.390038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1018/2023] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:59.394464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.405654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67224015-0c55-4f83-94f7-e713c1632786 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.410957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.411673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.411956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.412222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] PATH_INFO: `/v3/projects/6e3c344ab3f1411393c1b8af41919005/users/df810fc485ac46c4847b4f3819a3658f/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.429080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3c344ab3f1411393c1b8af41919005, user_id=df810fc485ac46c4847b4f3819a3658f, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.431821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.448616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1006/2024] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:59 2022] PUT /identity/v3/projects/6e3c344ab3f1411393c1b8af41919005/users/df810fc485ac46c4847b4f3819a3658f/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:59.452576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.464078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e56cf9-5a6a-4ecd-b4d1-4bd9dda0937f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.499743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:02:59.535944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c2ca3-bbf7-41b3-a157-85cac96f4ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.536561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c2ca3-bbf7-41b3-a157-85cac96f4ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.536809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c2ca3-bbf7-41b3-a157-85cac96f4ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.537101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c2ca3-bbf7-41b3-a157-85cac96f4ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.537756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c2ca3-bbf7-41b3-a157-85cac96f4ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.539396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c2ca3-bbf7-41b3-a157-85cac96f4ca1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.550284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1019/2025] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:02:59.554643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.566289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ec8c-b071-44ea-8023-a7556e1b0272 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.571431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.572103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.572377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.572647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] PATH_INFO: `/v3/projects/6e3c344ab3f1411393c1b8af41919005/users/df810fc485ac46c4847b4f3819a3658f/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.575906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3c344ab3f1411393c1b8af41919005, user_id=df810fc485ac46c4847b4f3819a3658f, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.578670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.590953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1007/2026] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:02:59 2022] PUT /identity/v3/projects/6e3c344ab3f1411393c1b8af41919005/users/df810fc485ac46c4847b4f3819a3658f/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:02:59.601792 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417f5b-bd24-4cf5-838d-63a94b93ae6a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.602067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417f5b-bd24-4cf5-838d-63a94b93ae6a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.602331 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417f5b-bd24-4cf5-838d-63a94b93ae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.633617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f2417f5b-bd24-4cf5-838d-63a94b93ae6a None None] MFA Rules not processed for user `df810fc485ac46c4847b4f3819a3658f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:02:59.634990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f2417f5b-bd24-4cf5-838d-63a94b93ae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:59.707590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1020/2027] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:02:59 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:02:59.719132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.721233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:02:59.782590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb0c2b-f165-44cd-93fa-871419e9a5e4 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.786642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.787259 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.787534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.787801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.797334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.798793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.809111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1008/2028] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:59 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:02:59.890814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2417f5b-bd24-4cf5-838d-63a94b93ae6a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:02:59.901415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2417f5b-bd24-4cf5-838d-63a94b93ae6a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:02:59.905955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:02:59.906571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:02:59.906840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:02:59.907102 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:02:59.966824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:02:59.968215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:02:59.977788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1021/2029] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:02:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:00.766826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:00.769136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:00.856213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e4f7d-381a-4062-a52d-6e011181d902 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:00.862182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:00.862832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:00.863114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:00.863385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] PATH_INFO: `/v3/users/1bd64fa1961a424b8195381366154e06` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:00.864545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd64fa1961a424b8195381366154e06)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:00.866538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:00.916487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:00.938706 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd64fa1961a424b8195381366154e06'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:00.952646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd64fa1961a424b8195381366154e06'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:00.953508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd64fa1961a424b8195381366154e06'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:00.960969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd64fa1961a424b8195381366154e06'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:00.961756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6cbd2dc4-9998-43b6-b7da-e7f2f44c9f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd64fa1961a424b8195381366154e06'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:00.976776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1009/2030] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:00 2022] DELETE /identity/v3/users/1bd64fa1961a424b8195381366154e06 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:01.157663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:01.170410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2f6e3-8258-42a1-a2c5-2b66882de287 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:01.221293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:01.233813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:01.234463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:01.234738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:01.235009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] PATH_INFO: `/v3/projects/b9dab49ef00c4bb0bc1c27bc18a4f440` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:01.236128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9dab49ef00c4bb0bc1c27bc18a4f440)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:01.238141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:01.285744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9dab49ef00c4bb0bc1c27bc18a4f440', 'request_id': 'req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:01.292886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9dab49ef00c4bb0bc1c27bc18a4f440', 'request_id': 'req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:01.298729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9dab49ef00c4bb0bc1c27bc18a4f440', 'request_id': 'req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:01.313221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] The token cache is being invalidate because project b9dab49ef00c4bb0bc1c27bc18a4f440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:01.313555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:01.314200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:01.315882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1022/2031] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:01 2022] DELETE /identity/v3/projects/b9dab49ef00c4bb0bc1c27bc18a4f440 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:03.790687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:03.791176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:03.791316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:03.812414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:03.813821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:03.877654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1010/2032] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:03.933685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:03.935468 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:04.015872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b7aca-9eb3-4f70-8b5a-28a4b55cde2b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:04.021392 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646ce0c-7c85-4dd6-8908-837390a52fd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:04.022031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ce0c-7c85-4dd6-8908-837390a52fd6 service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:04.022307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ce0c-7c85-4dd6-8908-837390a52fd6 service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:04.022579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646ce0c-7c85-4dd6-8908-837390a52fd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:04.031479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646ce0c-7c85-4dd6-8908-837390a52fd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:04.033135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646ce0c-7c85-4dd6-8908-837390a52fd6 service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:04.042226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1023/2033] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:03:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:03:04.215339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:04.218548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:04.358832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30e626-3cb2-45dc-b193-eda2cbb8c9ce None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:04.364375 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:04.365035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:04.365494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:04.365755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] PATH_INFO: `/v3/users/6b54124732944b8d852f0fe1eca78946` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:04.367716 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b54124732944b8d852f0fe1eca78946)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:04.369835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:04.483899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b54124732944b8d852f0fe1eca78946'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:04.499386 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:04.511343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b54124732944b8d852f0fe1eca78946'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:04.511343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b54124732944b8d852f0fe1eca78946'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:04.521222 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b54124732944b8d852f0fe1eca78946'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:04.522083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b54124732944b8d852f0fe1eca78946'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:04.539637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1011/2034] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:04 2022] DELETE /identity/v3/users/6b54124732944b8d852f0fe1eca78946 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:04.544569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:04.545053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:04.545515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:04.568784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:04.571242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:04.646903 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1024/2035] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:04.657316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:04.658820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:04.736241 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc843048-636b-407c-9805-c3d94a004bc6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:04.741289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:04.742488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:04.742936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:04.743387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:04.754253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:04.757048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:04.767331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1012/2036] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:05.108949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:05.110411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:05.123422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824ea0e-f018-4929-bfd7-84cad2330785 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:05.130847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:05.132017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:05.132527 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:05.133018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] PATH_INFO: `/v3/projects/281cf9853f4a40ceb4c7d2532ab5bfae` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:05.142676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=281cf9853f4a40ceb4c7d2532ab5bfae)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:05.145542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:05.149070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:05.218968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281cf9853f4a40ceb4c7d2532ab5bfae', 'request_id': 'req-3efcf493-db17-4980-84fa-5227063ffc15'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.227376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281cf9853f4a40ceb4c7d2532ab5bfae', 'request_id': 'req-3efcf493-db17-4980-84fa-5227063ffc15'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.235484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281cf9853f4a40ceb4c7d2532ab5bfae', 'request_id': 'req-3efcf493-db17-4980-84fa-5227063ffc15'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.252031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] The token cache is being invalidate because project 281cf9853f4a40ceb4c7d2532ab5bfae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:05.252450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.253332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.255018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1025/2037] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:05 2022] DELETE /identity/v3/projects/281cf9853f4a40ceb4c7d2532ab5bfae => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:05.259564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:05.271526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fa38f-0d8c-490f-b9a2-8015cbb16e73 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:05.357120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:05.357720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:05.357998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:05.358265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] PATH_INFO: `/v3/users/df810fc485ac46c4847b4f3819a3658f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:05.359880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=df810fc485ac46c4847b4f3819a3658f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:05.363559 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:05.450050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df810fc485ac46c4847b4f3819a3658f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.476593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df810fc485ac46c4847b4f3819a3658f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.477825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df810fc485ac46c4847b4f3819a3658f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.494571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df810fc485ac46c4847b4f3819a3658f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.495684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df810fc485ac46c4847b4f3819a3658f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:05.499583 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:05.522727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1013/2038] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:05 2022] DELETE /identity/v3/users/df810fc485ac46c4847b4f3819a3658f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:05.942500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:05.944319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:05.963335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efcf493-db17-4980-84fa-5227063ffc15 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.028968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:06.031013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:06.047005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.047816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.048169 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.048528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] PATH_INFO: `/v3/projects/6e3c344ab3f1411393c1b8af41919005` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.049928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3c344ab3f1411393c1b8af41919005)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.052232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.123729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3c344ab3f1411393c1b8af41919005', 'request_id': 'req-47852704-7d53-4dd5-accd-30a78eef857d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:06.131558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3c344ab3f1411393c1b8af41919005', 'request_id': 'req-47852704-7d53-4dd5-accd-30a78eef857d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:06.136175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d49cd5-5854-4b33-89c5-cd570b825b0c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.138586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3c344ab3f1411393c1b8af41919005', 'request_id': 'req-47852704-7d53-4dd5-accd-30a78eef857d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:06.159166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] The token cache is being invalidate because project 6e3c344ab3f1411393c1b8af41919005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:06.159713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:06.160620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-47852704-7d53-4dd5-accd-30a78eef857d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:06.163138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1026/2039] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:05 2022] DELETE /identity/v3/projects/6e3c344ab3f1411393c1b8af41919005 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:06.170786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d57bcf-4cd8-4ace-b507-273638750696 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.171118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d57bcf-4cd8-4ace-b507-273638750696 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.171300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d57bcf-4cd8-4ace-b507-273638750696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.198005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-53d57bcf-4cd8-4ace-b507-273638750696 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:06.200220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-53d57bcf-4cd8-4ace-b507-273638750696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:06.224089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:06.242815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.243859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.244239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.244613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.247576 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:06.285708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1027/2040] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:06.290220 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665bf27-16ad-47b1-a49b-f7fbc29bcf0b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.291931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665bf27-16ad-47b1-a49b-f7fbc29bcf0b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.292415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665bf27-16ad-47b1-a49b-f7fbc29bcf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.317222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-1665bf27-16ad-47b1-a49b-f7fbc29bcf0b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:06.318272 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1665bf27-16ad-47b1-a49b-f7fbc29bcf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:06.332716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1028/2041] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:06.333674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665bf27-16ad-47b1-a49b-f7fbc29bcf0b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:06.343849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.344444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665bf27-16ad-47b1-a49b-f7fbc29bcf0b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.345542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.351947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.352690 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.353036 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.353566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.354152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:06.354522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.356244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.358955 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1014/2042] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:06.371742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1029/2043] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:03:06.376365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:06.401092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd2af5-bf01-4cda-ab8b-1f9cbb742980 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.411423 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.412702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.413191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.413515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.414170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.416217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.468159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1015/2044] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:06 2022] POST /identity/v3/projects => generated 361 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:06.472132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:06.485463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af78c3e-32b0-4a0d-92a4-1b7acd63556f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.562847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.563892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.564479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.564948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.565817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.568289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.598892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1030/2045] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:06 2022] POST /identity/v3/users => generated 281 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:03:06.601167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:06.620698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2c73d-20e7-491d-bb2a-eeac1a8988b8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.625726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.626340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.626618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.626961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.627613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.629439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.631373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:06.655182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1016/2046] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:06.655580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:06.670609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be15d80-be9e-4d1a-bce9-107327287a08 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.685244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae8fa6-d352-420c-a5a2-140478e9802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.686173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8fa6-d352-420c-a5a2-140478e9802e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.686789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8fa6-d352-420c-a5a2-140478e9802e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.689829 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae8fa6-d352-420c-a5a2-140478e9802e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.693862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae8fa6-d352-420c-a5a2-140478e9802e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.696625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae8fa6-d352-420c-a5a2-140478e9802e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.710578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1031/2047] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:06.716391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:06.734139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3da8e-48a6-4cd5-84a5-1411d187f9c2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:06.742017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:06.742769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.743546 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.743929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] PATH_INFO: `/v3/projects/936d292b3d6b4ce39c5e3da47ac276ad/users/bcffadfa2aba49a797ed182db67275e6/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.789673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=936d292b3d6b4ce39c5e3da47ac276ad, user_id=bcffadfa2aba49a797ed182db67275e6, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:06.793138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:06.828635 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1017/2048] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:06 2022] PUT /identity/v3/projects/936d292b3d6b4ce39c5e3da47ac276ad/users/bcffadfa2aba49a797ed182db67275e6/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:06.842043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040159-75fc-4c9b-b80f-cbbc4f54858c None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:06.842327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040159-75fc-4c9b-b80f-cbbc4f54858c None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:06.842602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4040159-75fc-4c9b-b80f-cbbc4f54858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:06.885044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d4040159-75fc-4c9b-b80f-cbbc4f54858c None None] MFA Rules not processed for user `bcffadfa2aba49a797ed182db67275e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:06.887091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d4040159-75fc-4c9b-b80f-cbbc4f54858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:06.997011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1032/2049] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:07.048257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:07.050329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:07.129805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bf1ea-5252-4851-a8de-a12060d329cf admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:07.133730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcd15d-f8e1-4678-9970-1c202375916a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:07.134370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd15d-f8e1-4678-9970-1c202375916a service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:07.134651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd15d-f8e1-4678-9970-1c202375916a service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:07.134925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcd15d-f8e1-4678-9970-1c202375916a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:07.152528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd15d-f8e1-4678-9970-1c202375916a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:07.154117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcd15d-f8e1-4678-9970-1c202375916a service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:07.164836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1018/2050] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:07.182475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4040159-75fc-4c9b-b80f-cbbc4f54858c None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:07.202642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:07.284680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4040159-75fc-4c9b-b80f-cbbc4f54858c None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:07.289405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:07.290063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:07.290337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:07.290601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] PATH_INFO: `/v3/users/bcffadfa2aba49a797ed182db67275e6` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:07.292004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcffadfa2aba49a797ed182db67275e6)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:07.293695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:07.362532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcffadfa2aba49a797ed182db67275e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:07.363617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcffadfa2aba49a797ed182db67275e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:07.364651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcffadfa2aba49a797ed182db67275e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:07.383222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcffadfa2aba49a797ed182db67275e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:07.394222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcffadfa2aba49a797ed182db67275e6'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:07.419426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1033/2051] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:07 2022] DELETE /identity/v3/users/bcffadfa2aba49a797ed182db67275e6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:07.424014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:07.424536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:07.424983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:07.446678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:07.448043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:07.540117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1019/2052] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:07.552910 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:07.554568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:07.622173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083abc7-2937-4fab-af06-0c763eea5578 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:07.628356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9f83f-737b-4f11-9068-67a32d8571fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:07.629130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9f83f-737b-4f11-9068-67a32d8571fc service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:07.629503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9f83f-737b-4f11-9068-67a32d8571fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:07.629899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9f83f-737b-4f11-9068-67a32d8571fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:07.640822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9f83f-737b-4f11-9068-67a32d8571fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:07.642489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9f83f-737b-4f11-9068-67a32d8571fc service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:07.654135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1034/2053] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:08.051720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:08.055553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:08.119543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beffbf5-7083-40bd-b190-c5499b251d36 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:08.141700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:08.143909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.144458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.145613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] PATH_INFO: `/v3/projects/936d292b3d6b4ce39c5e3da47ac276ad` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.149609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] RBAC: Authorizing `identity:delete_project(project_id=936d292b3d6b4ce39c5e3da47ac276ad)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:08.153127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:08.266974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936d292b3d6b4ce39c5e3da47ac276ad', 'request_id': 'req-343587fa-6737-429c-8e43-0456a7c1e66e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:08.275587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936d292b3d6b4ce39c5e3da47ac276ad', 'request_id': 'req-343587fa-6737-429c-8e43-0456a7c1e66e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:08.282902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936d292b3d6b4ce39c5e3da47ac276ad', 'request_id': 'req-343587fa-6737-429c-8e43-0456a7c1e66e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:08.295480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:08.301344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] The token cache is being invalidate because project 936d292b3d6b4ce39c5e3da47ac276ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:08.301551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:08.302374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-343587fa-6737-429c-8e43-0456a7c1e66e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:08.309926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1020/2054] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:08 2022] DELETE /identity/v3/projects/936d292b3d6b4ce39c5e3da47ac276ad => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:08.315842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88f9e-1567-45bf-b862-b471b1a80b34 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.317042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88f9e-1567-45bf-b862-b471b1a80b34 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.317621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88f9e-1567-45bf-b862-b471b1a80b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.342862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fef88f9e-1567-45bf-b862-b471b1a80b34 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:08.344351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fef88f9e-1567-45bf-b862-b471b1a80b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:08.406575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:08.484142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1035/2055] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:08.487377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db75f-f00c-4fff-a9ba-e2cd20a825c4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.488047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db75f-f00c-4fff-a9ba-e2cd20a825c4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.488452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db75f-f00c-4fff-a9ba-e2cd20a825c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.522025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-610db75f-f00c-4fff-a9ba-e2cd20a825c4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:08.523680 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-610db75f-f00c-4fff-a9ba-e2cd20a825c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:08.536473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1021/2056] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:08.541938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88f9e-1567-45bf-b862-b471b1a80b34 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:08.556611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88f9e-1567-45bf-b862-b471b1a80b34 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:08.562323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:08.563104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.563445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.563787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.564551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:08.564919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:08.566760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:08.589467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1036/2057] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:03:08.594223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db75f-f00c-4fff-a9ba-e2cd20a825c4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:08.604523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db75f-f00c-4fff-a9ba-e2cd20a825c4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:08.614606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:08.615262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.615564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.615821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.616841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:08.618894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:08.660207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1022/2058] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:08 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:03:08.664709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:08.680165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8420de-4ef4-4d52-9022-83be7bff6185 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:08.770843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:08.772083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.772083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.772681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.773037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:08.775491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:08.827146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1037/2059] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:08 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:03:08.829195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:08.841593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ad44c-7cdb-468f-98c0-49911ec2471d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:08.852690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:08.853617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.853974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.854325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.855056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:08.856756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:08.875629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1023/2060] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:08.876807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:08.893547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365e1de-031e-4ac9-b0b2-e9e0e0c25a0a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:08.898646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d7b80-d9b1-4482-870d-72b7c6ac8f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:08.899347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7b80-d9b1-4482-870d-72b7c6ac8f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.899627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7b80-d9b1-4482-870d-72b7c6ac8f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.899902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d7b80-d9b1-4482-870d-72b7c6ac8f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.900560 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d7b80-d9b1-4482-870d-72b7c6ac8f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:08.902246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d7b80-d9b1-4482-870d-72b7c6ac8f52 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:08.929773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1038/2061] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:08.930617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:08.942329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18991036-50fd-4503-b69e-f190d49d6094 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:08.948695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:08.953944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:08.953944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:08.953944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] PATH_INFO: `/v3/projects/d2a3fef2b2f84d21bac8ff503dd9b685/users/3c10d9bff3bf474ea27cf45c80bf17b1/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:08.976969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a3fef2b2f84d21bac8ff503dd9b685, user_id=3c10d9bff3bf474ea27cf45c80bf17b1, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:08.979833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:09.003528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1024/2062] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:08 2022] PUT /identity/v3/projects/d2a3fef2b2f84d21bac8ff503dd9b685/users/3c10d9bff3bf474ea27cf45c80bf17b1/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:09.014839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b55e2-b9ba-476a-95c4-13c72208ffc1 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:09.015568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b55e2-b9ba-476a-95c4-13c72208ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:09.016254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b55e2-b9ba-476a-95c4-13c72208ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:09.073889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d04b55e2-b9ba-476a-95c4-13c72208ffc1 None None] MFA Rules not processed for user `3c10d9bff3bf474ea27cf45c80bf17b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:09.075133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d04b55e2-b9ba-476a-95c4-13c72208ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:09.186798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1039/2063] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:09.191388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:09.357895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9eeba6-bb57-4e3e-94f6-14d0ad9ca634 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:09.363711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:09.365855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:09.367402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:09.368062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:09.369001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:09.371258 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:09.418792 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1025/2064] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:09 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:09.422552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b55e2-b9ba-476a-95c4-13c72208ffc1 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:09.434291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b55e2-b9ba-476a-95c4-13c72208ffc1 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:09.469358 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:09.525915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:09.526599 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:09.526896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:09.527138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:09.527835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:09.529777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:09.572187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1040/2065] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:09 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:09.576225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:09.594026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bdf42-5b97-4ff1-8606-dd49cda34c26 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:09.601665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:09.603553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:09.604277 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:09.604892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:09.605815 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:09.607872 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:09.636306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1026/2066] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:09.640649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:09.654397 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35fc3bb-38d1-44ca-a4ad-92a3f97d94ee admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:09.660306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9102a8-4cab-428c-a20b-4e6b7b984462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:09.660963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9102a8-4cab-428c-a20b-4e6b7b984462 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:09.661236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9102a8-4cab-428c-a20b-4e6b7b984462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:09.661536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9102a8-4cab-428c-a20b-4e6b7b984462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:09.662189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9102a8-4cab-428c-a20b-4e6b7b984462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:09.664138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9102a8-4cab-428c-a20b-4e6b7b984462 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:09.682470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1041/2067] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:09.683629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:09.694665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ec86a-a6ca-408b-9cf6-7bd568a12d30 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:09.699592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:09.700356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:09.700865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:09.701082 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] PATH_INFO: `/v3/projects/bd247d75b39b4909a4000c478ac854f4/users/74a1b54a92d649068cd96e2f46bc4878/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:09.729078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd247d75b39b4909a4000c478ac854f4, user_id=74a1b54a92d649068cd96e2f46bc4878, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:09.732045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:09.750327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1027/2068] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:09 2022] PUT /identity/v3/projects/bd247d75b39b4909a4000c478ac854f4/users/74a1b54a92d649068cd96e2f46bc4878/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:09.762987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf40b0-5550-49a1-8341-c1231de454e4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:09.762987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf40b0-5550-49a1-8341-c1231de454e4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:09.762987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf40b0-5550-49a1-8341-c1231de454e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:09.800404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6dcf40b0-5550-49a1-8341-c1231de454e4 None None] MFA Rules not processed for user `74a1b54a92d649068cd96e2f46bc4878`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:09.802062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6dcf40b0-5550-49a1-8341-c1231de454e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:09.905293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1042/2069] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:09.909663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:09.988485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:10.011442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ea64f-e91c-4a32-9bec-351a242e6a20 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:10.017234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:10.017928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.018207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.018479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.019148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:10.021156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:10.066005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1028/2070] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:09 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:10.071172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf40b0-5550-49a1-8341-c1231de454e4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:10.088306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf40b0-5550-49a1-8341-c1231de454e4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:10.157868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:10.158931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.159205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.159470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.160127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:10.162178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:10.191211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1043/2071] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:10 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:10.192477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:10.205256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c28a7-d72f-4c51-bf43-3fb559fca2c6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:10.210269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:10.210715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.210993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.211276 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.211939 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:10.213606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:10.228504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1029/2072] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:10.232793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:10.245006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bd1a6-494a-4380-a4cb-d731aa83aaa7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:10.249954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:10.250664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.250942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.251212 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] PATH_INFO: `/v3/projects/b10db05030544dab960c6857868b329e/users/b60ced38fddc4ec38a8182ac7afe9783/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.269993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10db05030544dab960c6857868b329e, user_id=b60ced38fddc4ec38a8182ac7afe9783, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:10.273061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:10.296301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1044/2073] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:10 2022] PUT /identity/v3/projects/b10db05030544dab960c6857868b329e/users/b60ced38fddc4ec38a8182ac7afe9783/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:10.302398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:10.314374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53630dfc-5ce2-46c0-acac-fb85216ee4d7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:10.396725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed391c0-186d-4634-adde-331b3811b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:10.397539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed391c0-186d-4634-adde-331b3811b9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.397842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed391c0-186d-4634-adde-331b3811b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.398143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed391c0-186d-4634-adde-331b3811b9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.399192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed391c0-186d-4634-adde-331b3811b9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:10.400569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed391c0-186d-4634-adde-331b3811b9b1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:10.417933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1030/2074] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:10.423903 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:10.445705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:10.454981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a6905-1ce5-4312-b0bf-807650f7f1fe admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:10.461052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:10.461779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.462059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.462333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] PATH_INFO: `/v3/projects/b10db05030544dab960c6857868b329e/users/b60ced38fddc4ec38a8182ac7afe9783/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.464303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10db05030544dab960c6857868b329e, user_id=b60ced38fddc4ec38a8182ac7afe9783, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:10.466995 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:10.478656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1045/2075] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:10 2022] PUT /identity/v3/projects/b10db05030544dab960c6857868b329e/users/b60ced38fddc4ec38a8182ac7afe9783/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:10.489501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1788c-5516-44b4-844a-7ea53089d350 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.489826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1788c-5516-44b4-844a-7ea53089d350 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.490108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1788c-5516-44b4-844a-7ea53089d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.542650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-69f1788c-5516-44b4-844a-7ea53089d350 None None] MFA Rules not processed for user `b60ced38fddc4ec38a8182ac7afe9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:10.543071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-69f1788c-5516-44b4-844a-7ea53089d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:10.698062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1031/2076] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:10.731098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:10.733741 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:10.855230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7155d8-a63c-4fef-b700-b73573451900 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:10.865070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:10.866662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:10.866928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:10.867198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:10.961030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:10.963151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:10.979075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1046/2077] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:12.880695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1788c-5516-44b4-844a-7ea53089d350 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:12.888656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1788c-5516-44b4-844a-7ea53089d350 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:12.892440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:12.893120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:12.893490 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:12.893824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:12.976191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:13.025293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:13.027763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:13.042111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1032/2078] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:13.976429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:13.977990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:13.989953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703d9f9-49e1-4acd-b010-14a3a7b7e562 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:13.994523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ade9da-d2c3-43d5-a925-2293c7f2adfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:13.995267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade9da-d2c3-43d5-a925-2293c7f2adfc service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:13.995644 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade9da-d2c3-43d5-a925-2293c7f2adfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:13.996006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ade9da-d2c3-43d5-a925-2293c7f2adfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:14.010451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ade9da-d2c3-43d5-a925-2293c7f2adfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:14.010451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ade9da-d2c3-43d5-a925-2293c7f2adfc service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:14.019441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1047/2079] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:18.240582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:18.319645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8872-32fa-4b11-97cf-bd47bbe6d6d6 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:18.325421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:18.326306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:18.326641 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:18.327012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] PATH_INFO: `/v3/users/3c10d9bff3bf474ea27cf45c80bf17b1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:18.329236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c10d9bff3bf474ea27cf45c80bf17b1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:18.331550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:18.398841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c10d9bff3bf474ea27cf45c80bf17b1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:18.420353 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c10d9bff3bf474ea27cf45c80bf17b1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:18.422115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c10d9bff3bf474ea27cf45c80bf17b1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:18.435777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c10d9bff3bf474ea27cf45c80bf17b1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:18.437137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c10d9bff3bf474ea27cf45c80bf17b1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:18.467084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1033/2080] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:18 2022] DELETE /identity/v3/users/3c10d9bff3bf474ea27cf45c80bf17b1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:18.473221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:18.474201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:18.474813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:18.490078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:18.492899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:18.499837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:18.501663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:18.596784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1048/2081] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:18.605938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:18.607849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:18.622274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:18.657553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037e688-1bbc-4604-9981-54021038648b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:18.662197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:18.664316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:18.665096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:18.665454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:18.665703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:18.667607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:18.680744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:18.682441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:18.695377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1034/2082] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:18.697367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f7412-d0a4-41d8-a589-0b91087fefe3 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:18.701580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:18.702218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:18.702661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:18.702778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:18.726206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:18.727946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:18.743978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1049/2083] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:03:19.077987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:19.079549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:19.096605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c90e88-5858-49dd-91c7-f261aa9ac028 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:19.101781 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:19.102415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.102693 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.102973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] PATH_INFO: `/v3/projects/d2a3fef2b2f84d21bac8ff503dd9b685` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.105417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a3fef2b2f84d21bac8ff503dd9b685)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:19.106880 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:19.180689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a3fef2b2f84d21bac8ff503dd9b685', 'request_id': 'req-832469a1-6e18-455e-8ad0-6778036c28f3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.189422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a3fef2b2f84d21bac8ff503dd9b685', 'request_id': 'req-832469a1-6e18-455e-8ad0-6778036c28f3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.198183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a3fef2b2f84d21bac8ff503dd9b685', 'request_id': 'req-832469a1-6e18-455e-8ad0-6778036c28f3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.222205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] The token cache is being invalidate because project d2a3fef2b2f84d21bac8ff503dd9b685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:19.222694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.223682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-832469a1-6e18-455e-8ad0-6778036c28f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.226410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1035/2084] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:19 2022] DELETE /identity/v3/projects/d2a3fef2b2f84d21bac8ff503dd9b685 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:19.232152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:19.248391 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536049a-b05f-4693-8974-1d0c6c774d07 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:19.339001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:19.339805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.341512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.341512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] PATH_INFO: `/v3/users/74a1b54a92d649068cd96e2f46bc4878` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.342577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a1b54a92d649068cd96e2f46bc4878)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:19.344872 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:19.431190 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a1b54a92d649068cd96e2f46bc4878'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.432202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a1b54a92d649068cd96e2f46bc4878'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.433102 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a1b54a92d649068cd96e2f46bc4878'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.466837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a1b54a92d649068cd96e2f46bc4878'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.476287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9ad39-70e7-4e59-aaeb-2879afe078ea None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.476817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a1b54a92d649068cd96e2f46bc4878'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.478301 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9ad39-70e7-4e59-aaeb-2879afe078ea None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.478778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9ad39-70e7-4e59-aaeb-2879afe078ea None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.481894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1036/2085] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 20:03:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:03:19.488419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.488789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.489127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.503005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1050/2086] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:19 2022] DELETE /identity/v3/users/74a1b54a92d649068cd96e2f46bc4878 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:19.515283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:19.516496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:19.610889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1037/2087] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 20:03:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:19.625684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:19.627753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:19.698134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fc8be-648e-4958-86d1-777dfeefdf27 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:19.702385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ec022-d06b-4100-936b-411a82eb6fb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:19.703009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec022-d06b-4100-936b-411a82eb6fb4 service glance] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.703460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec022-d06b-4100-936b-411a82eb6fb4 service glance] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.703884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ec022-d06b-4100-936b-411a82eb6fb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.714088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:19.719011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec022-d06b-4100-936b-411a82eb6fb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:19.721414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ec022-d06b-4100-936b-411a82eb6fb4 service glance] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:19.735365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1051/2088] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:19.814097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:19.815898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:19.818555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10562fb-acfe-49fe-8340-481e76fe2589 None None] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.818919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10562fb-acfe-49fe-8340-481e76fe2589 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.819441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10562fb-acfe-49fe-8340-481e76fe2589 None None] PATH_INFO: `/` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.822053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1052/2089] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 20:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:03:19.827511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.827876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.828613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.850736 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] MFA Rules not processed for user `7157e60fb6fb4b84866ce59f051a9037`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:19.852017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:19.912829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:19.913114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1053/2090] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 20:03:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:19.917985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e008f62-f580-4181-a32b-4b3ad42d4b3e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:19.923820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:19.924834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.925209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.925610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] PATH_INFO: `/v3/projects/bd247d75b39b4909a4000c478ac854f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.926896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd247d75b39b4909a4000c478ac854f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:19.928905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:19.932532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:19.934637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:19.946383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1490a63-7664-4131-b2ce-d1c313aa0e3b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:19.950447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:19.951061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:19.951343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:19.951666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:19.959745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:19.961218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:19.971315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1054/2091] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:03:19.989705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd247d75b39b4909a4000c478ac854f4', 'request_id': 'req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:19.996940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd247d75b39b4909a4000c478ac854f4', 'request_id': 'req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.002953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd247d75b39b4909a4000c478ac854f4', 'request_id': 'req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.017803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] The token cache is being invalidate because project bd247d75b39b4909a4000c478ac854f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:20.018253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.018934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-1a84b861-6ae3-438a-b5a6-31e0efdb38e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.020516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1038/2092] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:19 2022] DELETE /identity/v3/projects/bd247d75b39b4909a4000c478ac854f4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:20.024635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:20.036505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8354ddb-2d5c-4036-8fd8-66887bbf98e4 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:20.063699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2a9b-3599-449b-86b2-23dc40b35844 None None] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.063937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2a9b-3599-449b-86b2-23dc40b35844 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.064240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac2a9b-3599-449b-86b2-23dc40b35844 None None] PATH_INFO: `/` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.065821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1039/2093] 10.222.0.52 () {54 vars in 921 bytes} [Fri Oct 28 20:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 28 20:03:20.072478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.073704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.074375 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.096748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] MFA Rules not processed for user `8e5bd5f8509b414c8699ec51117745cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:20.098075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:20.101406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:20.102129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.102396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.102710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] PATH_INFO: `/v3/users/b60ced38fddc4ec38a8182ac7afe9783` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.103849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60ced38fddc4ec38a8182ac7afe9783)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:20.105842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:20.155086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60ced38fddc4ec38a8182ac7afe9783'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.155751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60ced38fddc4ec38a8182ac7afe9783'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.156366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60ced38fddc4ec38a8182ac7afe9783'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.168524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60ced38fddc4ec38a8182ac7afe9783'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.171132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1040/2094] 10.222.0.52 () {58 vars in 1018 bytes} [Fri Oct 28 20:03:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:20.176103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60ced38fddc4ec38a8182ac7afe9783'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.183141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:20.184851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:20.191473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1055/2095] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:20 2022] DELETE /identity/v3/users/b60ced38fddc4ec38a8182ac7afe9783 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:20.250199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c00c18-d60e-41a1-b0dc-b3c40472f720 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:20.284940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:20.304812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1dd978-2d66-4bcf-ae98-05086f3e4102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:20.305459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd978-2d66-4bcf-ae98-05086f3e4102 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.305739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd978-2d66-4bcf-ae98-05086f3e4102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.306010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1dd978-2d66-4bcf-ae98-05086f3e4102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.383264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dd978-2d66-4bcf-ae98-05086f3e4102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:20.384884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1dd978-2d66-4bcf-ae98-05086f3e4102 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:20.396405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1041/2096] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:20.485609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:20.487740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:20.506183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:20.575321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165743d-23d8-4b93-9006-8d8fb8835260 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:20.581915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:20.582753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.583092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.583464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] PATH_INFO: `/v3/projects/b10db05030544dab960c6857868b329e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.585450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10db05030544dab960c6857868b329e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:20.587784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:20.651241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10db05030544dab960c6857868b329e', 'request_id': 'req-506d7ff7-844f-49e2-9098-222b3afaeb76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.660463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10db05030544dab960c6857868b329e', 'request_id': 'req-506d7ff7-844f-49e2-9098-222b3afaeb76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.668918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10db05030544dab960c6857868b329e', 'request_id': 'req-506d7ff7-844f-49e2-9098-222b3afaeb76'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.691628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] The token cache is being invalidate because project b10db05030544dab960c6857868b329e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:20.692061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.693066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-506d7ff7-844f-49e2-9098-222b3afaeb76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:20.698676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1056/2097] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:20 2022] DELETE /identity/v3/projects/b10db05030544dab960c6857868b329e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:20.700250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fafd0-dddf-4219-accf-eef3eafd8b31 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.700699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fafd0-dddf-4219-accf-eef3eafd8b31 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.700905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fafd0-dddf-4219-accf-eef3eafd8b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.742979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-849fafd0-dddf-4219-accf-eef3eafd8b31 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:20.744332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-849fafd0-dddf-4219-accf-eef3eafd8b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:20.869457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1042/2098] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:20.943067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6be8-f12f-4d1c-9e5b-bc58c3b75f04 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.943431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6be8-f12f-4d1c-9e5b-bc58c3b75f04 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.943653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba6be8-f12f-4d1c-9e5b-bc58c3b75f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.966096 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-86ba6be8-f12f-4d1c-9e5b-bc58c3b75f04 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:20.967367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-86ba6be8-f12f-4d1c-9e5b-bc58c3b75f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:20.975628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1057/2099] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:20.979916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fafd0-dddf-4219-accf-eef3eafd8b31 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:20.990439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fafd0-dddf-4219-accf-eef3eafd8b31 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:20.995699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:20.996384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:20.996675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:20.997117 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:20.997788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:20.998154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:20.999813 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:21.015773 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1043/2100] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:03:21.017337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6be8-f12f-4d1c-9e5b-bc58c3b75f04 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:21.027992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba6be8-f12f-4d1c-9e5b-bc58c3b75f04 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:21.034037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:21.034666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:21.034981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:21.035263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:21.036168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:21.038221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:21.073547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1058/2101] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:21 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:03:21.077638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:21.094629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdbc67-e4c5-4a74-b089-e04829851fbe admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:21.160408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:21.161029 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:21.161305 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:21.161613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:21.162313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:21.164217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:21.174762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:21.190381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1044/2102] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:21 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:21.194634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:21.206724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db8fa6-042d-4328-912e-394dfe188b5f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:21.212171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:21.212798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:21.213074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:21.213344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:21.214031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:21.215669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:21.230050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1059/2103] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:21.231542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:21.243098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623b3b2-3488-46bb-b01b-d08263078288 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:21.248699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d5c4c-dba8-4f6c-9193-6d5faf362259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:21.249311 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d5c4c-dba8-4f6c-9193-6d5faf362259 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:21.249625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d5c4c-dba8-4f6c-9193-6d5faf362259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:21.249900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d5c4c-dba8-4f6c-9193-6d5faf362259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:21.250544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d5c4c-dba8-4f6c-9193-6d5faf362259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:21.252137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d5c4c-dba8-4f6c-9193-6d5faf362259 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:21.263643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1045/2104] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:21.267953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:21.278926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ed669-a4af-4712-b34d-7b1808235ef2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:21.284081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:21.284740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:21.285016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:21.285255 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] PATH_INFO: `/v3/projects/3ffcc9fe8cc44d2a9d2ffbd8fcd3b564/users/4c03d71d343f4a1598c99a1e944b848c/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:21.301308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ffcc9fe8cc44d2a9d2ffbd8fcd3b564, user_id=4c03d71d343f4a1598c99a1e944b848c, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:21.304006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:21.320888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1060/2105] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:21 2022] PUT /identity/v3/projects/3ffcc9fe8cc44d2a9d2ffbd8fcd3b564/users/4c03d71d343f4a1598c99a1e944b848c/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:21.332014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178ee96-b0fd-4ef4-96d0-93965c7bd732 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:21.332300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178ee96-b0fd-4ef4-96d0-93965c7bd732 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:21.332572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178ee96-b0fd-4ef4-96d0-93965c7bd732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:21.366504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0178ee96-b0fd-4ef4-96d0-93965c7bd732 None None] MFA Rules not processed for user `4c03d71d343f4a1598c99a1e944b848c`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:21.367749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0178ee96-b0fd-4ef4-96d0-93965c7bd732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:21.444377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1046/2106] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:21.456889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:21.458712 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:21.503552 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:21.524753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60d5b0-016f-4d17-861e-07847d613e52 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:21.528637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:21.529351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:21.529670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:21.529938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:21.539286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:21.540827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:21.550222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1061/2107] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:24.555206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:24.555742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:24.555742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:24.576991 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:24.578395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:24.644698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1047/2108] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:03:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:24.662243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:24.671794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:24.775861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b62160-d62f-470b-98e6-1bf2f2504a8c service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:24.785413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:24.786370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:24.786577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:24.786885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:24.796311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:24.797980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:24.833692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1062/2109] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:03:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:03:25.081583 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:25.083086 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:25.281862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ab73-02df-4aac-90cc-5316ccdab21d None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:25.292141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8668c-9cff-471c-aab5-9546231fc908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:25.294115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8668c-9cff-471c-aab5-9546231fc908 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:25.298552 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8668c-9cff-471c-aab5-9546231fc908 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:25.299442 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8668c-9cff-471c-aab5-9546231fc908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:25.303024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-87f8668c-9cff-471c-aab5-9546231fc908 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:25.334199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8668c-9cff-471c-aab5-9546231fc908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:25.336413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8668c-9cff-471c-aab5-9546231fc908 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:25.390214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1048/2110] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:32.409880 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:32.486596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de32b38-0245-415e-aaee-b21df7bbd9ac service swift] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:32.492668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:32.493318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:32.493623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:32.493897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] PATH_INFO: `/v3/users/4c03d71d343f4a1598c99a1e944b848c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:32.495024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c03d71d343f4a1598c99a1e944b848c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:32.496956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:32.572992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c03d71d343f4a1598c99a1e944b848c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:32.574318 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c03d71d343f4a1598c99a1e944b848c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:32.575100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c03d71d343f4a1598c99a1e944b848c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:32.591178 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c03d71d343f4a1598c99a1e944b848c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:32.599798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:32.602416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c03d71d343f4a1598c99a1e944b848c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:32.620513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1063/2111] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:32 2022] DELETE /identity/v3/users/4c03d71d343f4a1598c99a1e944b848c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:32.625458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:32.626268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:32.626268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:32.634390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:32.649556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:32.650878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:32.715002 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1049/2112] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:32.724798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:32.726248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:32.790699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee337e93-7259-4c16-905e-60b2c415f51e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:32.794640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f6df1-cf45-4cbe-a46e-ef3e52ba6cd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:32.795928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6df1-cf45-4cbe-a46e-ef3e52ba6cd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:32.795928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6df1-cf45-4cbe-a46e-ef3e52ba6cd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:32.795928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f6df1-cf45-4cbe-a46e-ef3e52ba6cd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:32.807663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f6df1-cf45-4cbe-a46e-ef3e52ba6cd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:32.809357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f6df1-cf45-4cbe-a46e-ef3e52ba6cd1 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:32.821681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1064/2113] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:33.461794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:33.463399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:33.475478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288207-d6cf-4cd2-8dbe-30afffcc1293 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:33.494916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:33.495708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.496406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.496406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] PATH_INFO: `/v3/projects/3ffcc9fe8cc44d2a9d2ffbd8fcd3b564` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.497713 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ffcc9fe8cc44d2a9d2ffbd8fcd3b564)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:33.499957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:33.563269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ffcc9fe8cc44d2a9d2ffbd8fcd3b564', 'request_id': 'req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:33.569996 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ffcc9fe8cc44d2a9d2ffbd8fcd3b564', 'request_id': 'req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:33.575561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ffcc9fe8cc44d2a9d2ffbd8fcd3b564', 'request_id': 'req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:33.590542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] The token cache is being invalidate because project 3ffcc9fe8cc44d2a9d2ffbd8fcd3b564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:33.590829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:33.591449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f2d5efa0-2d71-40d0-9192-8cb87f1d8b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:33.593040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1050/2114] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:33 2022] DELETE /identity/v3/projects/3ffcc9fe8cc44d2a9d2ffbd8fcd3b564 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:33.598055 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25227c32-bc61-480f-b831-fa0e10ac3f9e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.598578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25227c32-bc61-480f-b831-fa0e10ac3f9e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.598681 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25227c32-bc61-480f-b831-fa0e10ac3f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.618396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-25227c32-bc61-480f-b831-fa0e10ac3f9e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:33.619613 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-25227c32-bc61-480f-b831-fa0e10ac3f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:33.685629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1065/2115] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:33.694782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4cee-ee6f-487d-9ced-01b70b4124e8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.695333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4cee-ee6f-487d-9ced-01b70b4124e8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.695333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef4cee-ee6f-487d-9ced-01b70b4124e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.716580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-76ef4cee-ee6f-487d-9ced-01b70b4124e8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:33.717932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-76ef4cee-ee6f-487d-9ced-01b70b4124e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:33.731633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1051/2116] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:33.736430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25227c32-bc61-480f-b831-fa0e10ac3f9e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:33.751474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25227c32-bc61-480f-b831-fa0e10ac3f9e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:33.756780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:33.757490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.757856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.758216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.758950 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:33.759340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:33.761215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:33.774066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1066/2117] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:03:33.779997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4cee-ee6f-487d-9ced-01b70b4124e8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:33.791119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef4cee-ee6f-487d-9ced-01b70b4124e8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:33.797128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:33.797769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.798044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.798315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.798924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:33.800843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:33.832828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1052/2118] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:33 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:33.837637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:33.848166 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64a447-f93c-4d84-b930-eb4edcf1b128 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:33.906131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:33.906725 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.907002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.907277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.907902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:33.909939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:33.932875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1067/2119] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:33 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:33.937201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:33.948503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0598bc3-511f-41b4-8a2a-441cf1007039 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:33.954066 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:33.954767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.955057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.955376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.956053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:33.957774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:33.969147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1053/2120] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:33.973601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:33.983935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557eb7b-0a25-4a0e-a22f-c30d49bbcea9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:33.989061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b991f-1c10-4334-b1d5-b5c65b0d2738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:33.989691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b991f-1c10-4334-b1d5-b5c65b0d2738 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:33.990371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b991f-1c10-4334-b1d5-b5c65b0d2738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:33.990647 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b991f-1c10-4334-b1d5-b5c65b0d2738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:33.991303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b991f-1c10-4334-b1d5-b5c65b0d2738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:33.992988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b991f-1c10-4334-b1d5-b5c65b0d2738 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:33.995440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:34.006075 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1068/2121] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:34.010708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:34.021113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f88dc-f6fd-442d-944c-6f2b5aa7522e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:34.026439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:34.027091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:34.027384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:34.027652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] PATH_INFO: `/v3/projects/cd2459c93dd24a808436139c866a420f/users/c0231f6289fb459a9b8249ad29a0b191/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:34.044732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd2459c93dd24a808436139c866a420f, user_id=c0231f6289fb459a9b8249ad29a0b191, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:34.047416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:34.064483 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1054/2122] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:34 2022] PUT /identity/v3/projects/cd2459c93dd24a808436139c866a420f/users/c0231f6289fb459a9b8249ad29a0b191/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:34.070517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3e8b-384b-4d40-a433-d297fc17a77b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:34.070800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3e8b-384b-4d40-a433-d297fc17a77b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:34.071072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d3e8b-384b-4d40-a433-d297fc17a77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:34.094245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-067d3e8b-384b-4d40-a433-d297fc17a77b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:34.095496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-067d3e8b-384b-4d40-a433-d297fc17a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:34.161037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1069/2123] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:34.171380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:34.173195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:34.200347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:34.241245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001843ff-732c-4a15-bcc6-020262daecea admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:34.245688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:34.246304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:34.246640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:34.247017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:34.258419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:34.259838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:34.270195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1055/2124] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:40.298981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dadce5-480c-4766-bebd-a4fb12c67c89 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.299849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dadce5-480c-4766-bebd-a4fb12c67c89 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.299849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dadce5-480c-4766-bebd-a4fb12c67c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:40.332663 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-a4dadce5-480c-4766-bebd-a4fb12c67c89 None None] MFA Rules not processed for user `c0231f6289fb459a9b8249ad29a0b191`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:40.333999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a4dadce5-480c-4766-bebd-a4fb12c67c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:40.408459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1070/2125] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:40.414336 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:40.424186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe03fd-0a7a-4ccf-8679-c65017e30fa9 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:40.429132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:40.429946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.430223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.430498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:40.431139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:40.433062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:40.488490 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1056/2126] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:40 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:40.490239 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dadce5-480c-4766-bebd-a4fb12c67c89 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:40.510149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:40.512166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:40.516772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dadce5-480c-4766-bebd-a4fb12c67c89 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:40.588467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:40.589095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.589391 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.589686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:40.590342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:40.592295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:40.630536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1071/2127] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:40 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:03:40.634458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:40.656793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fe56-a1b4-4856-bdcb-5c405d5844c8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:40.657755 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b8d3-7dfb-41e8-a678-ea90a1d3e9cd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:40.666427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:40.667059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.667340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.667614 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:40.668286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:40.670064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:40.671284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:40.672480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.673526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.673870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:40.675877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:40.684610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1072/2128] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:40.689067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:40.709208 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:40.710134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67101c-9ccc-4349-afe7-f7b2c93e221b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:40.713484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:40.729112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:40.729859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.730123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.730400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] PATH_INFO: `/v3/projects/5241bc4a9989442f8da28384dfda1cb7/users/9aeac5981fca42a49b0fbe58715b5fec/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:40.732949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:40.736901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1057/2129] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:40.750067 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5241bc4a9989442f8da28384dfda1cb7, user_id=9aeac5981fca42a49b0fbe58715b5fec, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:40.754428 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:40.796866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1073/2130] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:40 2022] PUT /identity/v3/projects/5241bc4a9989442f8da28384dfda1cb7/users/9aeac5981fca42a49b0fbe58715b5fec/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:40.802789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:40.818727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60468-cc49-4a03-b2a9-cbdd7439a6a3 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:40.938213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05836d5-9263-41e1-9a87-129fb690f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:40.940187 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05836d5-9263-41e1-9a87-129fb690f78d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.940709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05836d5-9263-41e1-9a87-129fb690f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.942049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05836d5-9263-41e1-9a87-129fb690f78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:40.950308 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05836d5-9263-41e1-9a87-129fb690f78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:40.952505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05836d5-9263-41e1-9a87-129fb690f78d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:40.970674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1058/2131] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:40.974658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:40.991161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e403cce-0e42-46fc-8cb6-adf72e2d3da1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:40.996827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:40.997852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:40.998128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:40.998480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] PATH_INFO: `/v3/projects/5241bc4a9989442f8da28384dfda1cb7/users/9aeac5981fca42a49b0fbe58715b5fec/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:41.000439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5241bc4a9989442f8da28384dfda1cb7, user_id=9aeac5981fca42a49b0fbe58715b5fec, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:41.003398 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:41.033460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1074/2132] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:40 2022] PUT /identity/v3/projects/5241bc4a9989442f8da28384dfda1cb7/users/9aeac5981fca42a49b0fbe58715b5fec/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:41.764399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:41.764945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:41.764945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:41.793931 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:41.795274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:41.879753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:41.905396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1059/2133] 10.222.0.52 () {58 vars in 967 bytes} [Fri Oct 28 20:03:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:41.920070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:41.921964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:42.032778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84808c2-b031-4feb-9f1b-68320572f044 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:42.039905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:42.042421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:42.042912 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:42.043333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:42.054822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:42.057619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:42.067707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1075/2134] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:03:46.140252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:46.142532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:46.263325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e643f-037f-4f6c-9527-f04e3d2f7e66 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:46.268026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:46.268674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:46.268947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:46.269214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] PATH_INFO: `/v3/users/e2da9a7ca37b4010a65e088515adcc57` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:46.270424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2da9a7ca37b4010a65e088515adcc57)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:46.272371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:46.335974 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2da9a7ca37b4010a65e088515adcc57'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:46.357321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2da9a7ca37b4010a65e088515adcc57'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:46.358446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2da9a7ca37b4010a65e088515adcc57'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:46.372986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2da9a7ca37b4010a65e088515adcc57'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:46.376918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3a8f460-f84d-4d13-9467-29acd3080bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2da9a7ca37b4010a65e088515adcc57'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:46.413068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1060/2135] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:46 2022] DELETE /identity/v3/users/e2da9a7ca37b4010a65e088515adcc57 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:47.409730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:47.427094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9fc5-2364-49ba-9c6e-31cb6ddf11d6 service swift] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:47.514902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:47.515582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:47.516017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:47.516129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] PATH_INFO: `/v3/projects/26bbd6df389949d0813c99f7c94a696d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:47.517879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26bbd6df389949d0813c99f7c94a696d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:47.526530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:47.604879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26bbd6df389949d0813c99f7c94a696d', 'request_id': 'req-ad1e3ce3-6d92-44a1-92f0-28036bb16467'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:47.613550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26bbd6df389949d0813c99f7c94a696d', 'request_id': 'req-ad1e3ce3-6d92-44a1-92f0-28036bb16467'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:47.622783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26bbd6df389949d0813c99f7c94a696d', 'request_id': 'req-ad1e3ce3-6d92-44a1-92f0-28036bb16467'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:47.626295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:47.647312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] The token cache is being invalidate because project 26bbd6df389949d0813c99f7c94a696d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:47.657018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:47.657722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ad1e3ce3-6d92-44a1-92f0-28036bb16467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:47.659598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1076/2136] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:47 2022] DELETE /identity/v3/projects/26bbd6df389949d0813c99f7c94a696d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:47.664590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f413ea-0e66-4796-9f97-393e7b2392e4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:47.665147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f413ea-0e66-4796-9f97-393e7b2392e4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:47.665147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f413ea-0e66-4796-9f97-393e7b2392e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:47.702152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e2f413ea-0e66-4796-9f97-393e7b2392e4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:47.703468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e2f413ea-0e66-4796-9f97-393e7b2392e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:47.802132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1061/2137] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:47.803567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a794-e4e9-4e2d-a37c-8c20807f4802 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:47.804179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a794-e4e9-4e2d-a37c-8c20807f4802 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:47.804464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37a794-e4e9-4e2d-a37c-8c20807f4802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:47.847383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-0c37a794-e4e9-4e2d-a37c-8c20807f4802 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:47.848624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0c37a794-e4e9-4e2d-a37c-8c20807f4802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:47.867374 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1077/2138] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:47.872468 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f413ea-0e66-4796-9f97-393e7b2392e4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:47.885892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f413ea-0e66-4796-9f97-393e7b2392e4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:47.892902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:47.894017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:47.894752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:47.895437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:47.896259 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:47.896745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:47.900444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:47.903250 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:47.925249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1062/2139] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:03:47.930776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a794-e4e9-4e2d-a37c-8c20807f4802 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:47.943826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37a794-e4e9-4e2d-a37c-8c20807f4802 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:47.952989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:47.954002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:47.954547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:47.955004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:47.956087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:47.959148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:48.004107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1078/2140] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:47 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:03:48.008266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:48.023416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf127ad2-238a-4ca0-a274-7c7f6f2bbc96 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:48.194134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:48.194962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:48.195339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:48.195769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:48.196525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:48.199828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:48.257150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1063/2141] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:48 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:48.261429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:48.276485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed038d45-ef21-4bbb-917a-38f8071958d0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:48.283053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:48.283678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:48.283957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:48.284234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:48.285286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:48.286981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:48.301125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1079/2142] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:03:48.307316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:48.322553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93627d6-04ef-46ee-9690-cd79ae72d3a6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:48.329705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59e682-b004-4070-bf46-e8a041aa7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:48.330687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59e682-b004-4070-bf46-e8a041aa7f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:48.331175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59e682-b004-4070-bf46-e8a041aa7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:48.331718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59e682-b004-4070-bf46-e8a041aa7f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:48.332859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59e682-b004-4070-bf46-e8a041aa7f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:48.334892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59e682-b004-4070-bf46-e8a041aa7f81 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:48.348421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1064/2143] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:48.353988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:48.379677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270fff9-9b24-46d9-ab04-75362b6e121e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:48.385202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:48.386360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:48.387400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:48.387400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] PATH_INFO: `/v3/projects/95f36b5f69354712b006c96bedca5700/users/c3d10c28695a41578f9112f521252603/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:48.405592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f36b5f69354712b006c96bedca5700, user_id=c3d10c28695a41578f9112f521252603, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:48.408926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:48.437777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1080/2144] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:48 2022] PUT /identity/v3/projects/95f36b5f69354712b006c96bedca5700/users/c3d10c28695a41578f9112f521252603/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:48.444800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff5cb-3457-454c-870b-54c5faeb70e7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:48.445554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff5cb-3457-454c-870b-54c5faeb70e7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:48.445832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270ff5cb-3457-454c-870b-54c5faeb70e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:48.488844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-270ff5cb-3457-454c-870b-54c5faeb70e7 None None] MFA Rules not processed for user `c3d10c28695a41578f9112f521252603`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:48.491217 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-270ff5cb-3457-454c-870b-54c5faeb70e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:48.616284 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:48.617512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1065/2145] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:48.752947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ee7df-0fc8-46a6-ab8a-e10a1a01bfdc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:48.758429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87e85-2a67-439f-b56d-1f2800b3f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:48.759080 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87e85-2a67-439f-b56d-1f2800b3f51f admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:48.759535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87e85-2a67-439f-b56d-1f2800b3f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:48.759853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87e85-2a67-439f-b56d-1f2800b3f51f admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:48.760508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87e85-2a67-439f-b56d-1f2800b3f51f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:48.765738 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87e85-2a67-439f-b56d-1f2800b3f51f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:48.818121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1081/2146] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:48 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:48.820429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ff5cb-3457-454c-870b-54c5faeb70e7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:48.848778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270ff5cb-3457-454c-870b-54c5faeb70e7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:49.024582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.024873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.025148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.042847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:49.043409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.043682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.043950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.044600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:49.046924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:49.063109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:49.075340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] MFA Rules not processed for user `9aeac5981fca42a49b0fbe58715b5fec`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:49.076705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:49.100648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1066/2147] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:48 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:49.102431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:49.118765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d6b74-2ea1-40ed-9dc7-8c3ced472c8e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:49.124219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:49.126581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.126882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.127157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.127966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:49.131339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:49.152959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1067/2148] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:49.158057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:49.174356 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2058cb-519b-4872-ae64-775c76277410 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:49.194986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:49.200318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.200639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.201240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] PATH_INFO: `/v3/projects/79f49859a6294a78ab22ff366dd1f73e/users/c312e41d848442e2964c658a24633d14/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.207765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:49.220367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f49859a6294a78ab22ff366dd1f73e, user_id=c312e41d848442e2964c658a24633d14, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:49.225764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:49.246527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1068/2149] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:49 2022] PUT /identity/v3/projects/79f49859a6294a78ab22ff366dd1f73e/users/c312e41d848442e2964c658a24633d14/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:49.259879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:49.260658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1082/2150] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:49.268782 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:49.270810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:49.391045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3805a-843f-48db-9dbe-675c8021f391 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:49.395751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:49.396757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.397004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.397344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.398035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:49.402387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:49.411048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7396e-3396-49a3-b2ff-4467195f7cb8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:49.421918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1069/2151] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:49.427365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:49.439488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85707ee-3bac-46b5-9e74-8aac6b600922 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:49.447448 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22683cee-f040-43c2-a483-1b20c65e8f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:49.448440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22683cee-f040-43c2-a483-1b20c65e8f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.448920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22683cee-f040-43c2-a483-1b20c65e8f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.449459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22683cee-f040-43c2-a483-1b20c65e8f9a admin admin] PATH_INFO: `/v3/projects/79f49859a6294a78ab22ff366dd1f73e/users/c312e41d848442e2964c658a24633d14/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.451907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22683cee-f040-43c2-a483-1b20c65e8f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79f49859a6294a78ab22ff366dd1f73e, user_id=c312e41d848442e2964c658a24633d14, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:49.454802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22683cee-f040-43c2-a483-1b20c65e8f9a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:49.468461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1070/2152] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:49 2022] PUT /identity/v3/projects/79f49859a6294a78ab22ff366dd1f73e/users/c312e41d848442e2964c658a24633d14/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:49.480391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.480665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.480941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.520550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] MFA Rules not processed for user `c312e41d848442e2964c658a24633d14`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:49.520837 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:49.522366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.522728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:49.523345 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.523772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.525912 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:49.620977 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:49.624335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:49.633309 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1071/2153] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:49.643512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:49.644952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:49.659499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1083/2154] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:49.701091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:49.754198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9962fad-423b-400a-aa9d-f8ddf54f232e None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:49.758446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300c997-10fe-4691-a459-98d43dc95083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:49.759123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c997-10fe-4691-a459-98d43dc95083 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:49.759403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c997-10fe-4691-a459-98d43dc95083 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:49.759748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300c997-10fe-4691-a459-98d43dc95083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:49.771168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300c997-10fe-4691-a459-98d43dc95083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:49.778636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300c997-10fe-4691-a459-98d43dc95083 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:49.800875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1072/2155] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:50.289342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:50.307142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd99d87-a46c-4125-a1a0-c97f79f452aa service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:50.340888 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:50.371965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:50.372608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:50.372884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:50.373152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] PATH_INFO: `/v3/users/c3d10c28695a41578f9112f521252603` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:50.374342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d10c28695a41578f9112f521252603)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:50.376426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:50.432567 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d10c28695a41578f9112f521252603'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:50.433257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d10c28695a41578f9112f521252603'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:50.434009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d10c28695a41578f9112f521252603'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:50.448149 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d10c28695a41578f9112f521252603'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:50.455963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d10c28695a41578f9112f521252603'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:50.474827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1084/2156] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:50 2022] DELETE /identity/v3/users/c3d10c28695a41578f9112f521252603 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:50.480839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:50.482075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:50.482075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:50.506869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:50.508154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:50.579159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1073/2157] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:50.589082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:50.590610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:50.666386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c08933-3ea7-48dd-befa-5c708f615b84 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:50.681339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528cb455-b22a-4be6-8283-831f70edfe90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:50.683845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cb455-b22a-4be6-8283-831f70edfe90 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:50.684224 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cb455-b22a-4be6-8283-831f70edfe90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:50.684966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528cb455-b22a-4be6-8283-831f70edfe90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:50.703188 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cb455-b22a-4be6-8283-831f70edfe90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:50.705048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528cb455-b22a-4be6-8283-831f70edfe90 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:50.728119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1085/2158] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:50.795139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:50.796805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:50.811542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc362b-e44c-4a21-8ee9-8a4d2bd52cc7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:50.818295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:50.819191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:50.819724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:50.820123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:50.822515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:50.843676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:50.843919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:50.868848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1074/2159] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:50.952541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b95a2-ce9d-44f3-acf5-64ddd585b083 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:50.952840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b95a2-ce9d-44f3-acf5-64ddd585b083 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:50.953091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b95a2-ce9d-44f3-acf5-64ddd585b083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:50.976195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-686b95a2-ce9d-44f3-acf5-64ddd585b083 None None] MFA Rules not processed for user `c0231f6289fb459a9b8249ad29a0b191`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:50.977570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-686b95a2-ce9d-44f3-acf5-64ddd585b083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:51.067063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:51.086259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1086/2160] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:51.203464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:51.205644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:51.226464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ed770-131f-4bbb-a7af-0daa1422f38e service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:51.239828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:51.241140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:51.241552 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:51.241844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] PATH_INFO: `/v3/projects/95f36b5f69354712b006c96bedca5700` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:51.243333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f36b5f69354712b006c96bedca5700)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:51.247087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:51.363202 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f36b5f69354712b006c96bedca5700', 'request_id': 'req-ff28fa5b-a6a4-45fb-8a47-92056860b613'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.373445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f36b5f69354712b006c96bedca5700', 'request_id': 'req-ff28fa5b-a6a4-45fb-8a47-92056860b613'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.381806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f36b5f69354712b006c96bedca5700', 'request_id': 'req-ff28fa5b-a6a4-45fb-8a47-92056860b613'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.417188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] The token cache is being invalidate because project 95f36b5f69354712b006c96bedca5700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:51.417741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.418925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.428261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1075/2161] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:51 2022] DELETE /identity/v3/projects/95f36b5f69354712b006c96bedca5700 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:51.429164 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b95a2-ce9d-44f3-acf5-64ddd585b083 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:51.450116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b95a2-ce9d-44f3-acf5-64ddd585b083 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:51.525704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:51.526971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:51.527534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:51.528068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] PATH_INFO: `/v3/users/c312e41d848442e2964c658a24633d14` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:51.529702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c312e41d848442e2964c658a24633d14)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:51.532933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:51.616871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c312e41d848442e2964c658a24633d14'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.617926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c312e41d848442e2964c658a24633d14'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.618437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c312e41d848442e2964c658a24633d14'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.679437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c312e41d848442e2964c658a24633d14'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.695003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-e02eca75-aa12-4606-b3e6-22a7db602b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c312e41d848442e2964c658a24633d14'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:51.719683 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1087/2162] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:51 2022] DELETE /identity/v3/users/c312e41d848442e2964c658a24633d14 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:52.288515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:52.294275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:52.336435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28fa5b-a6a4-45fb-8a47-92056860b613 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:52.423879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:52.482508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:52.482508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:52.482869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:52.482869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] PATH_INFO: `/v3/projects/79f49859a6294a78ab22ff366dd1f73e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:52.485950 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79f49859a6294a78ab22ff366dd1f73e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:52.488273 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:52.579462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79f49859a6294a78ab22ff366dd1f73e', 'request_id': 'req-99631aaf-bfd3-4e18-a066-b71542789d21'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:52.590103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79f49859a6294a78ab22ff366dd1f73e', 'request_id': 'req-99631aaf-bfd3-4e18-a066-b71542789d21'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:52.601175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79f49859a6294a78ab22ff366dd1f73e', 'request_id': 'req-99631aaf-bfd3-4e18-a066-b71542789d21'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:52.630900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] The token cache is being invalidate because project 79f49859a6294a78ab22ff366dd1f73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:52.631369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:52.632255 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-99631aaf-bfd3-4e18-a066-b71542789d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:52.635048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1076/2163] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:52 2022] DELETE /identity/v3/projects/79f49859a6294a78ab22ff366dd1f73e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:52.650709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529270c-8c5d-462d-a964-b1fa7c13c8e2 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:52.651311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529270c-8c5d-462d-a964-b1fa7c13c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:52.651550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529270c-8c5d-462d-a964-b1fa7c13c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:52.676897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d529270c-8c5d-462d-a964-b1fa7c13c8e2 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:52.678922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d529270c-8c5d-462d-a964-b1fa7c13c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:52.774248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1088/2164] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:52.782055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988962f-14bb-4e06-853d-f6a05fcadb75 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:52.782343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988962f-14bb-4e06-853d-f6a05fcadb75 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:52.782618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988962f-14bb-4e06-853d-f6a05fcadb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:52.820551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4988962f-14bb-4e06-853d-f6a05fcadb75 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:52.830032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4988962f-14bb-4e06-853d-f6a05fcadb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:52.839610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1077/2165] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:52.846633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529270c-8c5d-462d-a964-b1fa7c13c8e2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:52.861846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529270c-8c5d-462d-a964-b1fa7c13c8e2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:52.867943 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:52.868957 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:52.869083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:52.869413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:52.871459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:52.871722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:52.873587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:52.894608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1089/2166] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:03:52.899307 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988962f-14bb-4e06-853d-f6a05fcadb75 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:52.909352 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988962f-14bb-4e06-853d-f6a05fcadb75 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:52.914329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:52.915722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:52.915861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:52.916134 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:52.917171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:52.918743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:52.966497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1078/2167] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:52 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:52.970826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:52.987857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:52.996369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8907d9-3206-47cb-ba31-abd7f45a806e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:53.081610 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:53.082400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.082675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.083130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.083814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:53.086193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:53.127182 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1090/2168] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:52 2022] POST /identity/v3/users => generated 282 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:53.131070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:53.143347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187d1a4b-0999-4acc-8ed6-6a5c57f43bfa admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:53.169207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:53.169884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.170162 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.170589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.171124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:53.173058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:53.203347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1079/2169] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:53.204355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:53.234895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fb061-9c1c-4138-b17a-e721bdd8885c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:53.256135 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a1dfd-6e46-4a47-8e64-5d060a09b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:53.257032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1dfd-6e46-4a47-8e64-5d060a09b3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.257317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1dfd-6e46-4a47-8e64-5d060a09b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.257636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a1dfd-6e46-4a47-8e64-5d060a09b3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.258330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a1dfd-6e46-4a47-8e64-5d060a09b3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:53.260333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a1dfd-6e46-4a47-8e64-5d060a09b3bb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:53.286861 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1091/2170] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:53.295034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:53.308539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1906e-a2eb-46f4-8a33-6c30d2a05148 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:53.331937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:53.332854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.333230 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.333621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] PATH_INFO: `/v3/projects/73b7d0383ab74259ab87a180ff51c3b1/users/6a2251ce92914cbf9aeaeedd21cfbef3/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.374364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b7d0383ab74259ab87a180ff51c3b1, user_id=6a2251ce92914cbf9aeaeedd21cfbef3, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:53.378987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:53.424450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1080/2171] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:53 2022] PUT /identity/v3/projects/73b7d0383ab74259ab87a180ff51c3b1/users/6a2251ce92914cbf9aeaeedd21cfbef3/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:53.436900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38838b-6b8b-4ed3-a19e-222e91a920de None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.437120 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38838b-6b8b-4ed3-a19e-222e91a920de None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.437800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38838b-6b8b-4ed3-a19e-222e91a920de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.497525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5f38838b-6b8b-4ed3-a19e-222e91a920de None None] MFA Rules not processed for user `6a2251ce92914cbf9aeaeedd21cfbef3`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:53.499669 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5f38838b-6b8b-4ed3-a19e-222e91a920de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:53.630479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1092/2172] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:53.631823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:53.782496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0641f-cbff-4ffe-8ba5-e495cb6fa2f7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:53.801312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:53.801312 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:53.801666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:53.802747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:53.804124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:53.810808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:53.843146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:53.883584 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1081/2173] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:53 2022] POST /identity/v3/projects => generated 363 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:53.888441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38838b-6b8b-4ed3-a19e-222e91a920de None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:53.929020 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38838b-6b8b-4ed3-a19e-222e91a920de None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.041413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.042126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.042446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.042671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.043347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.045371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.093449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1093/2174] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:53 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:54.097540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.114935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28538699-5aa3-45b8-9d61-419ae9439b61 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.122266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.123118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.123497 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.123844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.124760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.126583 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.142967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1082/2175] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:54.148815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.154440 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:54.165362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ff300-7789-4047-ad80-ab2c7ff48d54 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.171527 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.172335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.172710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.173043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] PATH_INFO: `/v3/projects/3d370f8ec43e4b5fa2210a8fa7f8c91c/users/5475a85eff7e4779b9671833e0eda097/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.202043 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d370f8ec43e4b5fa2210a8fa7f8c91c, user_id=5475a85eff7e4779b9671833e0eda097, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.204951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.222422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1094/2176] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:54 2022] PUT /identity/v3/projects/3d370f8ec43e4b5fa2210a8fa7f8c91c/users/5475a85eff7e4779b9671833e0eda097/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:54.226622 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.237776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb98cd-707c-4cfe-84a2-2779563d06ae admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.327037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6507db7b-60c4-4d3a-aab7-558034c2a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.327923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507db7b-60c4-4d3a-aab7-558034c2a16b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.328024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507db7b-60c4-4d3a-aab7-558034c2a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.328292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6507db7b-60c4-4d3a-aab7-558034c2a16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.329121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507db7b-60c4-4d3a-aab7-558034c2a16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.331060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6507db7b-60c4-4d3a-aab7-558034c2a16b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.345053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1083/2177] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:54.349086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.371625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f7a1cf-1a80-4541-83b6-e51ea3ab25d3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.381031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.381784 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.382107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.383019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] PATH_INFO: `/v3/projects/3d370f8ec43e4b5fa2210a8fa7f8c91c/users/5475a85eff7e4779b9671833e0eda097/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.385371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d370f8ec43e4b5fa2210a8fa7f8c91c, user_id=5475a85eff7e4779b9671833e0eda097, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.392608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.404625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1095/2178] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:54 2022] PUT /identity/v3/projects/3d370f8ec43e4b5fa2210a8fa7f8c91c/users/5475a85eff7e4779b9671833e0eda097/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:54.415567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7214bf-321f-4b8d-be1e-564fa810e9ee None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.415971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7214bf-321f-4b8d-be1e-564fa810e9ee None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.417205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7214bf-321f-4b8d-be1e-564fa810e9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.453827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-2f7214bf-321f-4b8d-be1e-564fa810e9ee None None] MFA Rules not processed for user `5475a85eff7e4779b9671833e0eda097`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:54.455111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2f7214bf-321f-4b8d-be1e-564fa810e9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:54.620573 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1084/2179] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:54.637748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.640274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:54.748894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f0ac15-1bdd-454a-8e77-59b1d9c576a5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.753097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.753937 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.754326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.754710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:54.768420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:54.770136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:54.782598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1096/2180] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:54.896598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7214bf-321f-4b8d-be1e-564fa810e9ee None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:54.913919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7214bf-321f-4b8d-be1e-564fa810e9ee None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:54.918131 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:54.918843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:54.919186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:54.920053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:55.051248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:55.052967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:55.058062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:55.077820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1085/2181] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:55.624931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:55.626491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:55.704753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:55.706676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:55.743276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5e68b-c989-4a66-bba1-f8bfe836825c service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:55.756971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:55.760988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:55.760988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:55.760988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:55.770825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:55.792411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:55.798601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:55.812621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1097/2182] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:55.828071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d0813-6254-43f1-bac6-863359016a8b service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:55.832929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:55.833627 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:55.833913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:55.834184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] PATH_INFO: `/v3/users/d4967aae8aa544d0b3da824976e0d9c4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:55.835350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4967aae8aa544d0b3da824976e0d9c4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:55.837306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:55.913046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4967aae8aa544d0b3da824976e0d9c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:55.925524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4967aae8aa544d0b3da824976e0d9c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:55.926399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4967aae8aa544d0b3da824976e0d9c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:55.934803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4967aae8aa544d0b3da824976e0d9c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:55.936088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cee2630a-1e45-407c-a7d7-8dc406127313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4967aae8aa544d0b3da824976e0d9c4'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:55.952390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1086/2183] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:55 2022] DELETE /identity/v3/users/d4967aae8aa544d0b3da824976e0d9c4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:56.176346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:56.188863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55757e6-9c56-4a80-91de-aa8a98cb309f service placement] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:56.262913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:56.270609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:56.271450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.272034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.272473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] PATH_INFO: `/v3/projects/24f97b4a7d55499da6023b8ba5951870` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.274147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f97b4a7d55499da6023b8ba5951870)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:56.276237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:56.344720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f97b4a7d55499da6023b8ba5951870', 'request_id': 'req-bbffc405-ace5-4c47-86e5-9f3ce81d0845'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:56.347058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f97b4a7d55499da6023b8ba5951870', 'request_id': 'req-bbffc405-ace5-4c47-86e5-9f3ce81d0845'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:56.354657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f97b4a7d55499da6023b8ba5951870', 'request_id': 'req-bbffc405-ace5-4c47-86e5-9f3ce81d0845'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:56.376921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] The token cache is being invalidate because project 24f97b4a7d55499da6023b8ba5951870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:56.377332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:56.378126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bbffc405-ace5-4c47-86e5-9f3ce81d0845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:56.382514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1098/2184] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:56 2022] DELETE /identity/v3/projects/24f97b4a7d55499da6023b8ba5951870 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:56.388018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb306-3c77-4b15-a18f-3fbd78b8ae46 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.388409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb306-3c77-4b15-a18f-3fbd78b8ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.388580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0eb306-3c77-4b15-a18f-3fbd78b8ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.409829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5d0eb306-3c77-4b15-a18f-3fbd78b8ae46 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:56.411063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5d0eb306-3c77-4b15-a18f-3fbd78b8ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:56.504106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1087/2185] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:56.512400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435c5f-99e6-46ee-876d-c50158959f0b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.512739 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435c5f-99e6-46ee-876d-c50158959f0b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.513077 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435c5f-99e6-46ee-876d-c50158959f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.556772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-ce435c5f-99e6-46ee-876d-c50158959f0b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:56.558319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ce435c5f-99e6-46ee-876d-c50158959f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:56.581621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eb306-3c77-4b15-a18f-3fbd78b8ae46 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:56.591100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1099/2186] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:56.596306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0eb306-3c77-4b15-a18f-3fbd78b8ae46 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:56.605527 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:56.606464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.606464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.607654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.608406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:03:56.608709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:56.610633 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:56.624873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1088/2187] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:03:56.629244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435c5f-99e6-46ee-876d-c50158959f0b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:56.643258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435c5f-99e6-46ee-876d-c50158959f0b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:56.654594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:56.654594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.654594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.654594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.655228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:56.655228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:56.709132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1100/2188] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:56 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:56.715462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:56.728922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:56.735384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2a2c2-cb8d-4ad6-90da-28b3d27fd9b6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:56.843903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:56.844572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.844843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.845109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.845781 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:56.847692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:56.873894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1089/2189] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:56 2022] POST /identity/v3/users => generated 284 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:56.879113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:56.890089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f74f61-8473-4c89-9138-63f58831b42d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:56.895625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:56.896228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.896800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.897087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.897825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:56.899437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:56.910928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1101/2190] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:56.918143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:56.934540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b741a9-afc6-444d-8ac9-5040bb60e3b6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:56.942231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc560e6-8697-401b-bb61-ce1d07246a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:56.943062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc560e6-8697-401b-bb61-ce1d07246a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.943566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc560e6-8697-401b-bb61-ce1d07246a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.944087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc560e6-8697-401b-bb61-ce1d07246a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:56.944855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc560e6-8697-401b-bb61-ce1d07246a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:56.947462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc560e6-8697-401b-bb61-ce1d07246a76 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:56.965873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1090/2191] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:56.967905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:56.979693 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1375-34e4-45d4-a9d4-1225aee07469 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:56.985529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:56.986194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:56.986592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:56.986740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] PATH_INFO: `/v3/projects/069053a6efd6423aabf870294824bdd9/users/1631078387ce4e9992cab8a8543cc235/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.011595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069053a6efd6423aabf870294824bdd9, user_id=1631078387ce4e9992cab8a8543cc235, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.017698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.045294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1102/2192] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:56 2022] PUT /identity/v3/projects/069053a6efd6423aabf870294824bdd9/users/1631078387ce4e9992cab8a8543cc235/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:57.060114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6dbd9-3adc-418a-8822-d3df73eccb43 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.060464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6dbd9-3adc-418a-8822-d3df73eccb43 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.060731 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6dbd9-3adc-418a-8822-d3df73eccb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.114717 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-58d6dbd9-3adc-418a-8822-d3df73eccb43 None None] MFA Rules not processed for user `1631078387ce4e9992cab8a8543cc235`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:57.115965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-58d6dbd9-3adc-418a-8822-d3df73eccb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:57.195400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1091/2193] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:57.201918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:57.280651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ee72e-755d-4412-9770-8a81ca2d0bd7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:57.286249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:57.287087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.287362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.287661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.288602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.290662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.323542 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1103/2194] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:03:57 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:57.328289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6dbd9-3adc-418a-8822-d3df73eccb43 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:57.340471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6dbd9-3adc-418a-8822-d3df73eccb43 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:57.412973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:57.413614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.413889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.414345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.415005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.417372 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.445306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1092/2195] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:03:57 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:03:57.449664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:57.462356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1584d57-534e-4745-b440-e74a85785632 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:57.467931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:57.468608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.468884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.469209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.469926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.471657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.474387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:57.485346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1104/2196] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:57.492664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:57.501451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:57.508871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e935165-7002-419b-b1dc-a9d5b5045d19 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:57.515161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:57.516149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.516435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.516710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] PATH_INFO: `/v3/projects/007bb0c7087148e79d0bcb3d8997d75e/users/7e13ea7fc0704624b88cdf47a0378083/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.535339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007bb0c7087148e79d0bcb3d8997d75e, user_id=7e13ea7fc0704624b88cdf47a0378083, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.538159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.560238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1093/2197] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:57 2022] PUT /identity/v3/projects/007bb0c7087148e79d0bcb3d8997d75e/users/7e13ea7fc0704624b88cdf47a0378083/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:57.564756 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:57.576379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb637b-3088-4e88-95db-ecd0f2216c31 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:57.650011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a268175-d790-433d-b803-e897120eebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:57.651124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a268175-d790-433d-b803-e897120eebf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.651514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a268175-d790-433d-b803-e897120eebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.651923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a268175-d790-433d-b803-e897120eebf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.652871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a268175-d790-433d-b803-e897120eebf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.655147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a268175-d790-433d-b803-e897120eebf7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.671168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1105/2198] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:03:57.676918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:57.688044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233ff91-c8ec-49f0-aa90-5e83bbad7608 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:57.693251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:57.693995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.694271 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.694541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] PATH_INFO: `/v3/projects/007bb0c7087148e79d0bcb3d8997d75e/users/7e13ea7fc0704624b88cdf47a0378083/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.697000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007bb0c7087148e79d0bcb3d8997d75e, user_id=7e13ea7fc0704624b88cdf47a0378083, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.699993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.713988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1094/2199] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:03:57 2022] PUT /identity/v3/projects/007bb0c7087148e79d0bcb3d8997d75e/users/7e13ea7fc0704624b88cdf47a0378083/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:57.726807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.727091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.727368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.762540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] MFA Rules not processed for user `7e13ea7fc0704624b88cdf47a0378083`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:57.763808 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:57.853608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1106/2200] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:03:57.866942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:57.869659 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:57.937460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9b5f2-e084-47db-9aa9-2be939c16532 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:57.941488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80190385-a8d8-444d-96a0-3b8f777bd53c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:57.942135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80190385-a8d8-444d-96a0-3b8f777bd53c service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:57.942420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80190385-a8d8-444d-96a0-3b8f777bd53c service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:57.942688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80190385-a8d8-444d-96a0-3b8f777bd53c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:57.952952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80190385-a8d8-444d-96a0-3b8f777bd53c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:57.954466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80190385-a8d8-444d-96a0-3b8f777bd53c service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:57.965626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1095/2201] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:58.178686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:58.180685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:58.318652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1d7a1-53a9-4bbc-9ac3-1133ecce0b24 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:58.324598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:58.325418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:58.325805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:58.326168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] PATH_INFO: `/v3/users/6a2251ce92914cbf9aeaeedd21cfbef3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:58.327866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2251ce92914cbf9aeaeedd21cfbef3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:58.330383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:58.363153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:58.393287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2251ce92914cbf9aeaeedd21cfbef3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:58.394338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2251ce92914cbf9aeaeedd21cfbef3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:58.395011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2251ce92914cbf9aeaeedd21cfbef3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:58.414309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2251ce92914cbf9aeaeedd21cfbef3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:58.424082 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2251ce92914cbf9aeaeedd21cfbef3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:58.442053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1107/2202] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:58 2022] DELETE /identity/v3/users/6a2251ce92914cbf9aeaeedd21cfbef3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:58.447003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:58.447341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:58.447639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:58.475922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:03:58.477130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:58.587643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1096/2203] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:03:58.601847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:58.603473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:58.684631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb867c2a-6c29-403f-ad14-bac5e6406630 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:58.694592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:58.695747 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:58.696291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:58.696849 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:58.714770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:58.716745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:58.740361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1108/2204] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:03:59.169770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:59.171742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:59.200445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425eb20-d42d-4c14-8214-e36cd4f2d557 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:59.209135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:59.210754 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:59.213488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:59.214158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] PATH_INFO: `/v3/projects/73b7d0383ab74259ab87a180ff51c3b1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:59.216135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b7d0383ab74259ab87a180ff51c3b1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:59.221575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:59.311747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b7d0383ab74259ab87a180ff51c3b1', 'request_id': 'req-7416560a-765e-4c6b-9d19-5ac4339fe9c9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.320650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b7d0383ab74259ab87a180ff51c3b1', 'request_id': 'req-7416560a-765e-4c6b-9d19-5ac4339fe9c9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.328462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b7d0383ab74259ab87a180ff51c3b1', 'request_id': 'req-7416560a-765e-4c6b-9d19-5ac4339fe9c9'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.330884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:59.348390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] The token cache is being invalidate because project 73b7d0383ab74259ab87a180ff51c3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:03:59.348733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.349413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.351223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1097/2205] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:03:59 2022] DELETE /identity/v3/projects/73b7d0383ab74259ab87a180ff51c3b1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:03:59.357446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:59.374825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce6625-d59f-4e93-9012-000fb08f62f7 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:03:59.464664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:03:59.465839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:03:59.466114 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:03:59.466379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] PATH_INFO: `/v3/users/5475a85eff7e4779b9671833e0eda097` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:03:59.467592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5475a85eff7e4779b9671833e0eda097)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:03:59.469778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:03:59.545340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:03:59.548924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5475a85eff7e4779b9671833e0eda097'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.550321 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5475a85eff7e4779b9671833e0eda097'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.552303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5475a85eff7e4779b9671833e0eda097'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.579724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5475a85eff7e4779b9671833e0eda097'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.592054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5475a85eff7e4779b9671833e0eda097'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:03:59.608260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1109/2206] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:59 2022] DELETE /identity/v3/users/5475a85eff7e4779b9671833e0eda097 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:03:59.962904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:03:59.964700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:03:59.979691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416560a-765e-4c6b-9d19-5ac4339fe9c9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.040172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.043887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:00.103079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.104392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.104964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.105542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] PATH_INFO: `/v3/users/1631078387ce4e9992cab8a8543cc235` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.107933 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1631078387ce4e9992cab8a8543cc235)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.111610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.165674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a1bde-28d1-4ebb-b39f-b1d3a1a06799 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.171380 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.171981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.172265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.172554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] PATH_INFO: `/v3/projects/3d370f8ec43e4b5fa2210a8fa7f8c91c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.173926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d370f8ec43e4b5fa2210a8fa7f8c91c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.175968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.187943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1631078387ce4e9992cab8a8543cc235'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.209176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1631078387ce4e9992cab8a8543cc235'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.210057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1631078387ce4e9992cab8a8543cc235'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.219525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1631078387ce4e9992cab8a8543cc235'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.220268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-728bf277-7844-458a-b676-920a0abd557b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1631078387ce4e9992cab8a8543cc235'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.238059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1098/2207] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:03:59 2022] DELETE /identity/v3/users/1631078387ce4e9992cab8a8543cc235 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:00.243757 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d370f8ec43e4b5fa2210a8fa7f8c91c', 'request_id': 'req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.245537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.245829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.246104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.257572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d370f8ec43e4b5fa2210a8fa7f8c91c', 'request_id': 'req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.264707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d370f8ec43e4b5fa2210a8fa7f8c91c', 'request_id': 'req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.267060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:00.268292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:00.284025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] The token cache is being invalidate because project 3d370f8ec43e4b5fa2210a8fa7f8c91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:00.284303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.285154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a7d6771b-9bd2-4344-a8ab-ebffcbe83117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:00.286896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1110/2208] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:00 2022] DELETE /identity/v3/projects/3d370f8ec43e4b5fa2210a8fa7f8c91c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:00.293420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370e24-5085-4ec6-8d3b-2f371a5bebca None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.293420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370e24-5085-4ec6-8d3b-2f371a5bebca None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.297011 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370e24-5085-4ec6-8d3b-2f371a5bebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.316948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c9370e24-5085-4ec6-8d3b-2f371a5bebca None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:00.318243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c9370e24-5085-4ec6-8d3b-2f371a5bebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:00.353626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1099/2209] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:00.367861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.370494 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:00.378842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:00.393807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:00.415032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1111/2210] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:00.417184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a445a-0a48-4fc5-8f80-9c536b519117 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.417502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a445a-0a48-4fc5-8f80-9c536b519117 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.417824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a445a-0a48-4fc5-8f80-9c536b519117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.442065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-355a445a-0a48-4fc5-8f80-9c536b519117 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:00.443846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-355a445a-0a48-4fc5-8f80-9c536b519117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:00.453590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1112/2211] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:00.457617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8be80-6b59-47d4-b2a6-690ae14e8bb3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.458715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a445a-0a48-4fc5-8f80-9c536b519117 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.463156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.463825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.464099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.464371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.469525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a445a-0a48-4fc5-8f80-9c536b519117 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.475200 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.475834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.476106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.476368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.476650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.477057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:00.477372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.478191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.479103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.490023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1100/2212] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:00.498168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1113/2213] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:00.502392 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.513110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdb5f6-1257-4d16-a5a0-d81c203222df service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.518136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.518751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.518751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.518751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.520521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.521945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.554690 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1101/2214] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:00 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:00.559559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.573918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd30b97f-355a-4236-859e-452084f68fa0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.656101 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.657157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.657703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.658186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.659329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.663231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.702510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1114/2215] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:00 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:00.706856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.718206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261eddf4-a678-47b0-ab74-675928948d0e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.724344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.725090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.725364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.725684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.726357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.728074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.741107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1102/2216] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:00.745492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.757894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970060e6-0958-4862-84dc-f607954c2ea6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.763745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.764711 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.765137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.765583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.766705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.768879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.790641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1115/2217] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:00.791714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.803785 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9cbaf2-3cde-4e6e-af83-aed6e3e484a2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.809638 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09377a-ff49-43ee-b703-6595bcf8853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.810287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09377a-ff49-43ee-b703-6595bcf8853d admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.810568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09377a-ff49-43ee-b703-6595bcf8853d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.810885 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09377a-ff49-43ee-b703-6595bcf8853d admin admin] PATH_INFO: `/v3/projects/5e1b917dfbf44206b25eee65bea9d9c7/users/87613cf4bf694750933928309c818934/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.846051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09377a-ff49-43ee-b703-6595bcf8853d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1b917dfbf44206b25eee65bea9d9c7, user_id=87613cf4bf694750933928309c818934, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.846051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09377a-ff49-43ee-b703-6595bcf8853d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.858050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1103/2218] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:00 2022] PUT /identity/v3/projects/5e1b917dfbf44206b25eee65bea9d9c7/users/87613cf4bf694750933928309c818934/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:00.873569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:00.876427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3030f-208f-41f9-b59d-37336b4ea681 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.876703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3030f-208f-41f9-b59d-37336b4ea681 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.877030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3030f-208f-41f9-b59d-37336b4ea681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.877449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:00.894317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f4f68-598f-438b-a888-2fc5594e097d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:00.913666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7ac3030f-208f-41f9-b59d-37336b4ea681 None None] MFA Rules not processed for user `87613cf4bf694750933928309c818934`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:00.915254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7ac3030f-208f-41f9-b59d-37336b4ea681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:00.965026 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:00.965814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:00.966162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:00.966523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] PATH_INFO: `/v3/projects/069053a6efd6423aabf870294824bdd9` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:00.967826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=069053a6efd6423aabf870294824bdd9)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:00.970197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:00.991702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1104/2219] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:00.997053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3030f-208f-41f9-b59d-37336b4ea681 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.011036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3030f-208f-41f9-b59d-37336b4ea681 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.016802 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.017441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.017723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.017991 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.018983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.020811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.032279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069053a6efd6423aabf870294824bdd9', 'request_id': 'req-44198661-11dc-4094-abf4-48174f5ebcfa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.035027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:01.042042 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069053a6efd6423aabf870294824bdd9', 'request_id': 'req-44198661-11dc-4094-abf4-48174f5ebcfa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.053275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069053a6efd6423aabf870294824bdd9', 'request_id': 'req-44198661-11dc-4094-abf4-48174f5ebcfa'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.060024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1105/2220] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:00 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:01.065973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.071546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] The token cache is being invalidate because project 069053a6efd6423aabf870294824bdd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:01.071827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.072537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.074145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1116/2221] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:00 2022] DELETE /identity/v3/projects/069053a6efd6423aabf870294824bdd9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:01.078479 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.080425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:01.099348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:01.147625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde31399-d7f7-46e1-9805-8f5992e3358c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.153575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.154455 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.154826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.155242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.156579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.163985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.182099 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44198661-11dc-4094-abf4-48174f5ebcfa admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.191802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.195407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1106/2222] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:01 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:01.196119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.196119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.196119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] PATH_INFO: `/v3/users/7e13ea7fc0704624b88cdf47a0378083` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.196812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.197905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e13ea7fc0704624b88cdf47a0378083)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.198824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:01.201834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.211816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dae62-bc42-4e1a-95a2-294e92130e0e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.216966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.217626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.217908 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.218181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.218907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.221367 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.234199 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1107/2223] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:01.239174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.253165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b4349-d845-413c-b616-10714caf0d87 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.262062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.263140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.263720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.264184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] PATH_INFO: `/v3/projects/7752d8546d4b4c9f9deaa26aee19404e/users/ee15cb4ae5ad44bca1a80b9da646aab1/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.282272 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e13ea7fc0704624b88cdf47a0378083'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.283028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e13ea7fc0704624b88cdf47a0378083'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.283427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7752d8546d4b4c9f9deaa26aee19404e, user_id=ee15cb4ae5ad44bca1a80b9da646aab1, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.283679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e13ea7fc0704624b88cdf47a0378083'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.289034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.299431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e13ea7fc0704624b88cdf47a0378083'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.306946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1108/2224] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:01 2022] PUT /identity/v3/projects/7752d8546d4b4c9f9deaa26aee19404e/users/ee15cb4ae5ad44bca1a80b9da646aab1/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:01.311415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.312761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e13ea7fc0704624b88cdf47a0378083'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.313119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:01.330029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1117/2225] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:01 2022] DELETE /identity/v3/users/7e13ea7fc0704624b88cdf47a0378083 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:01.387962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e633125-be8a-407d-ad14-21e64f07b5db admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.465597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b96a4-b53b-43df-8158-629321199214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.466858 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b96a4-b53b-43df-8158-629321199214 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.467206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b96a4-b53b-43df-8158-629321199214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.467687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b96a4-b53b-43df-8158-629321199214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.469097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b96a4-b53b-43df-8158-629321199214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.471569 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b96a4-b53b-43df-8158-629321199214 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.485605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1109/2226] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:01.490744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.502091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53383e97-b1fa-4819-af91-2982d0210d85 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.506904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.507584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.507860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.508439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] PATH_INFO: `/v3/projects/7752d8546d4b4c9f9deaa26aee19404e/users/ee15cb4ae5ad44bca1a80b9da646aab1/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.510860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7752d8546d4b4c9f9deaa26aee19404e, user_id=ee15cb4ae5ad44bca1a80b9da646aab1, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.513958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.529431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1118/2227] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:01 2022] PUT /identity/v3/projects/7752d8546d4b4c9f9deaa26aee19404e/users/ee15cb4ae5ad44bca1a80b9da646aab1/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:01.541740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.542046 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.542269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.573458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] MFA Rules not processed for user `ee15cb4ae5ad44bca1a80b9da646aab1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:01.575223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:01.589941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:01.657893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1110/2228] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:01.670266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.672037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:01.692428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:01.695439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:01.749034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:01.755709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411e3ff-83f7-4cfe-b500-06b9242dd058 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.761697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcef46-8ff2-4bb5-abf1-f93596ed6ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.762484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcef46-8ff2-4bb5-abf1-f93596ed6ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.762836 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcef46-8ff2-4bb5-abf1-f93596ed6ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.763214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcef46-8ff2-4bb5-abf1-f93596ed6ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.766083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-20bcef46-8ff2-4bb5-abf1-f93596ed6ed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:01.794526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cc10a-9b3f-4e7e-802f-9ee68f8621d9 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:01.801489 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:01.802121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.802416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.802771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] PATH_INFO: `/v3/projects/007bb0c7087148e79d0bcb3d8997d75e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.803929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=007bb0c7087148e79d0bcb3d8997d75e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.805892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.833893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcef46-8ff2-4bb5-abf1-f93596ed6ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:01.835765 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcef46-8ff2-4bb5-abf1-f93596ed6ed7 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:01.848574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1119/2229] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:01.871993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007bb0c7087148e79d0bcb3d8997d75e', 'request_id': 'req-183442a2-e74d-4919-8ec7-6e5df6467fed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.879120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007bb0c7087148e79d0bcb3d8997d75e', 'request_id': 'req-183442a2-e74d-4919-8ec7-6e5df6467fed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.885763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007bb0c7087148e79d0bcb3d8997d75e', 'request_id': 'req-183442a2-e74d-4919-8ec7-6e5df6467fed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.903882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] The token cache is being invalidate because project 007bb0c7087148e79d0bcb3d8997d75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:01.904166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.904850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-183442a2-e74d-4919-8ec7-6e5df6467fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:01.906992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1111/2230] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:01 2022] DELETE /identity/v3/projects/007bb0c7087148e79d0bcb3d8997d75e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:01.912030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b514c-ab48-4b10-a90e-c7e262051b74 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:01.912311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b514c-ab48-4b10-a90e-c7e262051b74 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:01.912558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b514c-ab48-4b10-a90e-c7e262051b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:01.933658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-725b514c-ab48-4b10-a90e-c7e262051b74 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:01.934860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-725b514c-ab48-4b10-a90e-c7e262051b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:02.002825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1120/2231] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:02.011274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b5dc-a6a6-4e9f-9a07-b22dd646a160 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.011578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b5dc-a6a6-4e9f-9a07-b22dd646a160 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.011849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7b5dc-a6a6-4e9f-9a07-b22dd646a160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.034129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-07a7b5dc-a6a6-4e9f-9a07-b22dd646a160 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:02.035364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-07a7b5dc-a6a6-4e9f-9a07-b22dd646a160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:02.043479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1112/2232] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:02.048294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b514c-ab48-4b10-a90e-c7e262051b74 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.058726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b514c-ab48-4b10-a90e-c7e262051b74 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.063672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.064316 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.064602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.064876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.065562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:02.065874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.067514 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.080362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1121/2233] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:02.086452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b5dc-a6a6-4e9f-9a07-b22dd646a160 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.096748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7b5dc-a6a6-4e9f-9a07-b22dd646a160 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.107475 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.108481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.108820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.109695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.110586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.113704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.159507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1113/2234] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:02 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:02.163201 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.175314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0bbc7d-2e7f-4799-8d6c-874b1467ba8f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.261010 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.261801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.262143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.262511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.263251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.265364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.291310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1122/2235] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:02 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:02.293727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.304918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cecaee-e0a0-43fb-ae81-214a5bc912cb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.310466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.311081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.311354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.311697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.312348 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.314214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.317043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:02.327253 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1114/2236] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:02.340287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.351023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465c569-3f5a-42eb-8637-ec685b1ef182 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.356204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c538fc4-66d8-452d-89bf-432193cbc211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.356842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538fc4-66d8-452d-89bf-432193cbc211 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.357155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538fc4-66d8-452d-89bf-432193cbc211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.357461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c538fc4-66d8-452d-89bf-432193cbc211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.358137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c538fc4-66d8-452d-89bf-432193cbc211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.359845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c538fc4-66d8-452d-89bf-432193cbc211 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.372262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1123/2237] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:02.377408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.388404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be1540-72bf-4d53-931a-40be9c582e95 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.394388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.395143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.395458 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.395779 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] PATH_INFO: `/v3/projects/f18e302d733a4337a0c18a208c2a11b6/users/74c77052a8fb4e6c99cbcc6b7a2157fd/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.415024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18e302d733a4337a0c18a208c2a11b6, user_id=74c77052a8fb4e6c99cbcc6b7a2157fd, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.417857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.435213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1115/2238] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:02 2022] PUT /identity/v3/projects/f18e302d733a4337a0c18a208c2a11b6/users/74c77052a8fb4e6c99cbcc6b7a2157fd/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:02.447236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f3b4-14d0-4214-9502-260b8a7cd61e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.447572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f3b4-14d0-4214-9502-260b8a7cd61e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.447751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094f3b4-14d0-4214-9502-260b8a7cd61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.462904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:02.481030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d094f3b4-14d0-4214-9502-260b8a7cd61e None None] MFA Rules not processed for user `74c77052a8fb4e6c99cbcc6b7a2157fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:02.482371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d094f3b4-14d0-4214-9502-260b8a7cd61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:02.569852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1124/2239] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:02.575200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.655954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd5089-1fa7-4686-9156-5c062061caf3 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.661651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.662265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.662580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.662842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.663782 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.666306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.701694 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1116/2240] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:02 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:02.707078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094f3b4-14d0-4214-9502-260b8a7cd61e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.719813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094f3b4-14d0-4214-9502-260b8a7cd61e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.784554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.785185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.785491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.785769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.786433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.788432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.815214 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1125/2241] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:02 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:02.820470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.831601 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1e67b-2830-4b3e-a454-05bec9725485 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.836889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.837586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.837860 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.838274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.838947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.840602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.853628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1117/2242] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:02.858340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.870418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0fe28-68ea-4114-8c03-e40ffb9a1fb5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.876249 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.876916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.877189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.877502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] PATH_INFO: `/v3/projects/8f88893a470e4d4bb6dac36f8fdda87f/users/5d36a4660d05480bad0f518208245ac4/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.895561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f88893a470e4d4bb6dac36f8fdda87f, user_id=5d36a4660d05480bad0f518208245ac4, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.898391 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:02.914326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1126/2243] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:02 2022] PUT /identity/v3/projects/8f88893a470e4d4bb6dac36f8fdda87f/users/5d36a4660d05480bad0f518208245ac4/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:02.918849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:02.930399 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d077f-6f9f-4516-9f10-907619661dd7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:02.996283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02e3e-4e1f-402e-bc3e-b5a946cc0bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:02.997021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02e3e-4e1f-402e-bc3e-b5a946cc0bfc admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:02.997300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02e3e-4e1f-402e-bc3e-b5a946cc0bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:02.997600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02e3e-4e1f-402e-bc3e-b5a946cc0bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:02.998248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a02e3e-4e1f-402e-bc3e-b5a946cc0bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:02.999884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a02e3e-4e1f-402e-bc3e-b5a946cc0bfc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.011039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1118/2244] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:03.015690 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.026577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fe50a-e33b-47a0-9805-0075910996f4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.031452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.032122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.032399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.032672 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] PATH_INFO: `/v3/projects/8f88893a470e4d4bb6dac36f8fdda87f/users/5d36a4660d05480bad0f518208245ac4/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.034633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f88893a470e4d4bb6dac36f8fdda87f, user_id=5d36a4660d05480bad0f518208245ac4, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.037333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.048916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1127/2245] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:03 2022] PUT /identity/v3/projects/8f88893a470e4d4bb6dac36f8fdda87f/users/5d36a4660d05480bad0f518208245ac4/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:03.061391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca734e-d4ee-4d5a-a0ea-951ad2231e27 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.061688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca734e-d4ee-4d5a-a0ea-951ad2231e27 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.061965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca734e-d4ee-4d5a-a0ea-951ad2231e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.092712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-54ca734e-d4ee-4d5a-a0ea-951ad2231e27 None None] MFA Rules not processed for user `5d36a4660d05480bad0f518208245ac4`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:03.094032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-54ca734e-d4ee-4d5a-a0ea-951ad2231e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:03.132560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:03.184566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1119/2246] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:03.200111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.201962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:03.275731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:03.290776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9d3e8-c5fa-4a9c-b42c-41499b95b8e7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.295309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.296012 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.296317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.296561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.325726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.327232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.339489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1128/2247] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:03.778420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca734e-d4ee-4d5a-a0ea-951ad2231e27 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.789057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca734e-d4ee-4d5a-a0ea-951ad2231e27 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.795076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36a4660d05480bad0f518208245ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f88893a470e4d4bb6dac36f8fdda87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.795890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.796264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.796581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.797421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:03.797892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.799720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.816040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1120/2248] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:03.821796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.831826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc76c8d-a283-4024-8bd0-2e8b3f1048ba service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.845081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36a4660d05480bad0f518208245ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f88893a470e4d4bb6dac36f8fdda87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.845748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.846027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.846299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.846981 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.849066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.879946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1129/2249] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:03 2022] POST /identity/v3/projects => generated 355 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:03.884418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:03.895759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5b1b2-ea10-494f-89c5-a38e3dd82d20 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:03.962745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36a4660d05480bad0f518208245ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f88893a470e4d4bb6dac36f8fdda87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:03.963370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:03.963651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:03.963928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:03.964618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:03.964919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:03.966854 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:03.982214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1121/2250] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:04:04.036972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.050482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398456f4-ca63-42e6-9a48-f72c82f32926 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.056790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d36a4660d05480bad0f518208245ac4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f88893a470e4d4bb6dac36f8fdda87f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.057554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.057907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.058222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] PATH_INFO: `/v3/projects/0bf6cfd6b46f4e629e79519bbc1338f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.059733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0bf6cfd6b46f4e629e79519bbc1338f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.061924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.121083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf6cfd6b46f4e629e79519bbc1338f4', 'request_id': 'req-cc5db41c-3050-415f-aa38-173a7081ace7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.128332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf6cfd6b46f4e629e79519bbc1338f4', 'request_id': 'req-cc5db41c-3050-415f-aa38-173a7081ace7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.134761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf6cfd6b46f4e629e79519bbc1338f4', 'request_id': 'req-cc5db41c-3050-415f-aa38-173a7081ace7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.150084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] The token cache is being invalidate because project 0bf6cfd6b46f4e629e79519bbc1338f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:04.150382 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.151035 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.152595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1130/2251] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:04 2022] DELETE /identity/v3/projects/0bf6cfd6b46f4e629e79519bbc1338f4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:04.390087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.392272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.463662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3fb65-61a0-4436-a61b-801f84c67025 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.541292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:04.550027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.551033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.551317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.551592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] PATH_INFO: `/v3/users/74c77052a8fb4e6c99cbcc6b7a2157fd` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.552959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c77052a8fb4e6c99cbcc6b7a2157fd)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.554942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.563612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.565685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.611549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c77052a8fb4e6c99cbcc6b7a2157fd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.629986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c77052a8fb4e6c99cbcc6b7a2157fd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.631786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c77052a8fb4e6c99cbcc6b7a2157fd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.644934 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c77052a8fb4e6c99cbcc6b7a2157fd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.645888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-ec771edc-e55e-4027-a59a-c710946f9d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c77052a8fb4e6c99cbcc6b7a2157fd'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:04.671635 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1122/2252] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:04 2022] DELETE /identity/v3/users/74c77052a8fb4e6c99cbcc6b7a2157fd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:04.673473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db41c-3050-415f-aa38-173a7081ace7 tempest-VolumeQuotaClassesTest-1224253839 tempest-VolumeQuotaClassesTest-1224253839-project-admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.678821 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.679365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.679833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.707973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:04.709212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.763420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.764621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.765137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.765565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.767975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.794519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1123/2253] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:04.795870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:04.805347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:04.807460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:04.874366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.876021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.885090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac718a6-3227-451f-be92-3c57a59a4424 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:04.887028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1131/2254] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:04.889050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:04.889754 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:04.890094 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:04.890562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:04.902108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:04.903882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:04.917332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1124/2255] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:05.449624 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.462626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c3a51-5563-4309-8f5f-82390984c7df service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.467215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.467974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.468418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.468820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.472133 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:05.484935 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.486326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.496605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1132/2256] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:05.635465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.637537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:05.665865 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534bf4-9a6c-49c2-8ad8-181dc38c41e3 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.673039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.673487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.673765 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.674065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] PATH_INFO: `/v3/projects/f18e302d733a4337a0c18a208c2a11b6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.675306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18e302d733a4337a0c18a208c2a11b6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.677316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.696007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:05.749370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18e302d733a4337a0c18a208c2a11b6', 'request_id': 'req-33e68754-1413-4c19-8d5c-6aa6f51395f7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.760791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18e302d733a4337a0c18a208c2a11b6', 'request_id': 'req-33e68754-1413-4c19-8d5c-6aa6f51395f7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.770287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18e302d733a4337a0c18a208c2a11b6', 'request_id': 'req-33e68754-1413-4c19-8d5c-6aa6f51395f7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.790783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] The token cache is being invalidate because project f18e302d733a4337a0c18a208c2a11b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:05.791257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.792096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.794198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1125/2257] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:05 2022] DELETE /identity/v3/projects/f18e302d733a4337a0c18a208c2a11b6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:05.798607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:05.812127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43eda6-3f07-4324-8526-3b198e8ff13a service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:05.880785 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:05.881475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:05.881753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:05.882027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] PATH_INFO: `/v3/users/5d36a4660d05480bad0f518208245ac4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:05.883207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d36a4660d05480bad0f518208245ac4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:05.885161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:05.942175 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d36a4660d05480bad0f518208245ac4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.942832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d36a4660d05480bad0f518208245ac4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.943429 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d36a4660d05480bad0f518208245ac4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.957107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d36a4660d05480bad0f518208245ac4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.964309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a53201cc-e29f-48e2-8f6a-e108cb99c1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d36a4660d05480bad0f518208245ac4'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:05.981832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1133/2258] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:05 2022] DELETE /identity/v3/users/5d36a4660d05480bad0f518208245ac4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:06.279878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.281591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:06.296490 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e68754-1413-4c19-8d5c-6aa6f51395f7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.361904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.362541 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.362818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.363405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] PATH_INFO: `/v3/projects/8f88893a470e4d4bb6dac36f8fdda87f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.364613 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f88893a470e4d4bb6dac36f8fdda87f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.366590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.424385 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f88893a470e4d4bb6dac36f8fdda87f', 'request_id': 'req-26360361-f003-4736-811b-be9c92a48470'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.431081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f88893a470e4d4bb6dac36f8fdda87f', 'request_id': 'req-26360361-f003-4736-811b-be9c92a48470'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.437536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f88893a470e4d4bb6dac36f8fdda87f', 'request_id': 'req-26360361-f003-4736-811b-be9c92a48470'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.450930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] The token cache is being invalidate because project 8f88893a470e4d4bb6dac36f8fdda87f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:06.451335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.451959 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-26360361-f003-4736-811b-be9c92a48470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:06.453655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1126/2259] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:06 2022] DELETE /identity/v3/projects/8f88893a470e4d4bb6dac36f8fdda87f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:06.459680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6557e-6245-4a00-993d-39c9ffdf7867 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.460256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6557e-6245-4a00-993d-39c9ffdf7867 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.460256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6557e-6245-4a00-993d-39c9ffdf7867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.483268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-23f6557e-6245-4a00-993d-39c9ffdf7867 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:06.484589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-23f6557e-6245-4a00-993d-39c9ffdf7867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:06.503797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:06.547668 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1134/2260] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:06.555617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb43f-2a40-421c-8fbf-8933c5733beb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.555906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb43f-2a40-421c-8fbf-8933c5733beb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.556179 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcfb43f-2a40-421c-8fbf-8933c5733beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.579184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-3fcfb43f-2a40-421c-8fbf-8933c5733beb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:06.580487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3fcfb43f-2a40-421c-8fbf-8933c5733beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:06.590119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1127/2261] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:06.594696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6557e-6245-4a00-993d-39c9ffdf7867 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.605004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6557e-6245-4a00-993d-39c9ffdf7867 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.610921 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.611561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.611882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.612147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.612842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:06.613500 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.615137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.627315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1135/2262] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:06.632146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfb43f-2a40-421c-8fbf-8933c5733beb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.641480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcfb43f-2a40-421c-8fbf-8933c5733beb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.646267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.646879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.647159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.647434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.648055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.650031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.682157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1128/2263] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:06 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:06.686499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.697070 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2b081-ff56-4ab7-957c-25262b935544 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.757485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.758096 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.758408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.758691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.759329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.761251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.785929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1136/2264] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:06 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:06.790397 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.797111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:06.800942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce701ab-a043-4626-9064-413134c42849 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.806800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.807398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.807852 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.808122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.808818 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.810658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.821681 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1129/2265] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:06.826219 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.836481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c123ef-6990-4549-849d-6beb8ae41764 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.847524 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5e916-7db8-4eae-a96f-e576a23eca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.848108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5e916-7db8-4eae-a96f-e576a23eca48 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.848377 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5e916-7db8-4eae-a96f-e576a23eca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.848645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5e916-7db8-4eae-a96f-e576a23eca48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.849295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5e916-7db8-4eae-a96f-e576a23eca48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.851040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5e916-7db8-4eae-a96f-e576a23eca48 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.864635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1137/2266] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:06.869282 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:06.879942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26150d1d-057d-47ee-a9f4-db3ae9181092 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:06.884832 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:06.885520 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.885793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.886060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] PATH_INFO: `/v3/projects/a2c4b717375445d4bdd352e7ab6c8260/users/3b5e971b491741e78a98ed131756a0f8/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.901617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c4b717375445d4bdd352e7ab6c8260, user_id=3b5e971b491741e78a98ed131756a0f8, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:06.904195 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:06.921593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1130/2267] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:06 2022] PUT /identity/v3/projects/a2c4b717375445d4bdd352e7ab6c8260/users/3b5e971b491741e78a98ed131756a0f8/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:06.933814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024643-e8ed-4e93-89d0-5cef3ce88471 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:06.934094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024643-e8ed-4e93-89d0-5cef3ce88471 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:06.934364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a024643-e8ed-4e93-89d0-5cef3ce88471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:06.963978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2a024643-e8ed-4e93-89d0-5cef3ce88471 None None] MFA Rules not processed for user `3b5e971b491741e78a98ed131756a0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:06.965193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2a024643-e8ed-4e93-89d0-5cef3ce88471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:07.041316 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1138/2268] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:07.045759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.129898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aaa96-3e8f-41f3-8cc1-26ed3207201c admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.135808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.136427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.136707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.136979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.137650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.139621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.176239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1131/2269] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:07.181197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024643-e8ed-4e93-89d0-5cef3ce88471 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.193504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a024643-e8ed-4e93-89d0-5cef3ce88471 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.214241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:07.272556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.273659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.274163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.274893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.275805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.279327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.311441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1139/2270] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:07.321428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.332580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61d33c-ed5d-428a-a09c-f33775136614 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.338704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.339414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.339698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.339967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.340611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.342266 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.354649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1132/2271] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:07.358528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.369314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fbc6-7e92-4090-90bc-948f650ddac9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.374411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54384578-a3c1-44bb-ae78-6d4d9ceee602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.375024 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54384578-a3c1-44bb-ae78-6d4d9ceee602 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.375300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54384578-a3c1-44bb-ae78-6d4d9ceee602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.375568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54384578-a3c1-44bb-ae78-6d4d9ceee602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.376223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54384578-a3c1-44bb-ae78-6d4d9ceee602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.377907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54384578-a3c1-44bb-ae78-6d4d9ceee602 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.392564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1140/2272] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:07.393795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.404119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34093a78-fa4e-45a2-bccb-a1351296617b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.409581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.410284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.410581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.410835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] PATH_INFO: `/v3/projects/d2229ff5d51041ea8acc929398ef2c72/users/d9447a984747460ab0f8fadbee077d22/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.428339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2229ff5d51041ea8acc929398ef2c72, user_id=d9447a984747460ab0f8fadbee077d22, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.431175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.449658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1133/2273] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:07 2022] PUT /identity/v3/projects/d2229ff5d51041ea8acc929398ef2c72/users/d9447a984747460ab0f8fadbee077d22/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:07.456657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa070-90cb-4818-bdca-21c88ba593ef None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.456968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa070-90cb-4818-bdca-21c88ba593ef None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.457238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508fa070-90cb-4818-bdca-21c88ba593ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.488820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-508fa070-90cb-4818-bdca-21c88ba593ef None None] MFA Rules not processed for user `d9447a984747460ab0f8fadbee077d22`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:07.490076 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-508fa070-90cb-4818-bdca-21c88ba593ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:07.573816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1141/2274] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:07.580068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.656214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a066c-bfba-49f6-acea-60538000f766 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.661021 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.661666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.661945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.662216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.662848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.664791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.697551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1134/2275] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:07.701862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fa070-90cb-4818-bdca-21c88ba593ef None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.714414 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508fa070-90cb-4818-bdca-21c88ba593ef None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.790933 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.791480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.791763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.792106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.792779 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.794860 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.824648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1142/2276] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:07 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:07.825856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.832570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:07.836640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b51a05-2a54-4aa5-8b0c-75c452e41d7d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.846132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.846760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.847044 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.847317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.847963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.849626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.861288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1135/2277] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:07.866110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.876233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b025-3450-4637-887a-7d1962b4cd98 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.881456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.882130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.882445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.882719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] PATH_INFO: `/v3/projects/b18cd85f4992467e8f6a737721a5d9c9/users/0484367f3706469a8f69c7db335354a0/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.899709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18cd85f4992467e8f6a737721a5d9c9, user_id=0484367f3706469a8f69c7db335354a0, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.902809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:07.905215 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:07.918434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1143/2278] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:07 2022] PUT /identity/v3/projects/b18cd85f4992467e8f6a737721a5d9c9/users/0484367f3706469a8f69c7db335354a0/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:07.922747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:07.933732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede63ff-9b28-4462-823d-ed7390d817d6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:07.992730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc11477-b957-4edb-a58d-2b8caf20e1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:07.993256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11477-b957-4edb-a58d-2b8caf20e1bd admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:07.993543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11477-b957-4edb-a58d-2b8caf20e1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:07.993843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc11477-b957-4edb-a58d-2b8caf20e1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:07.994482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc11477-b957-4edb-a58d-2b8caf20e1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:07.996090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc11477-b957-4edb-a58d-2b8caf20e1bd admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.006528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1136/2279] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:08.011098 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.022827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad588139-f5a5-402c-858b-f0265e506501 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.028202 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.028858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.029140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.029431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] PATH_INFO: `/v3/projects/b18cd85f4992467e8f6a737721a5d9c9/users/0484367f3706469a8f69c7db335354a0/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.031456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18cd85f4992467e8f6a737721a5d9c9, user_id=0484367f3706469a8f69c7db335354a0, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.034165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.045207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1144/2280] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:08 2022] PUT /identity/v3/projects/b18cd85f4992467e8f6a737721a5d9c9/users/0484367f3706469a8f69c7db335354a0/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:08.055967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1706da-44c0-4b9b-8cf9-266c1f22bdc4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.056254 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1706da-44c0-4b9b-8cf9-266c1f22bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.056535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1706da-44c0-4b9b-8cf9-266c1f22bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.087535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-ae1706da-44c0-4b9b-8cf9-266c1f22bdc4 None None] MFA Rules not processed for user `0484367f3706469a8f69c7db335354a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:08.088866 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ae1706da-44c0-4b9b-8cf9-266c1f22bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:08.178851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1137/2281] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:08.192635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:08.194423 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:08.287503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ec604-1992-4a0a-a576-5b8328f92c07 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:08.292052 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:08.292733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:08.292955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:08.293226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:08.303994 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:08.305478 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:08.317121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1145/2282] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:09.021313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1706da-44c0-4b9b-8cf9-266c1f22bdc4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:09.041239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1706da-44c0-4b9b-8cf9-266c1f22bdc4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:09.049607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:09.050553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:09.050870 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:09.051515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:09.124518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:09.126081 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:09.138515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1138/2283] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:13.392209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:13.408649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05e23c-a8a6-4e0d-8235-d23a798e9cb2 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:13.413777 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c5649-4990-44cf-a33a-0f9f29679d87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:13.414395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5649-4990-44cf-a33a-0f9f29679d87 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:13.414702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5649-4990-44cf-a33a-0f9f29679d87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:13.414989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c5649-4990-44cf-a33a-0f9f29679d87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:13.486465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c5649-4990-44cf-a33a-0f9f29679d87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:13.488232 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c5649-4990-44cf-a33a-0f9f29679d87 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:13.498970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1146/2284] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:15.821207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:15.835699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:15.887433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596472d-6ce9-4f16-bad9-fd3765049eee service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:15.892119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:15.892748 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:15.893025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:15.893295 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] PATH_INFO: `/v3/users/3b5e971b491741e78a98ed131756a0f8` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:15.894445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b5e971b491741e78a98ed131756a0f8)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:15.896365 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:15.955509 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b5e971b491741e78a98ed131756a0f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.967682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b5e971b491741e78a98ed131756a0f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.968540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b5e971b491741e78a98ed131756a0f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.976228 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b5e971b491741e78a98ed131756a0f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.976911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b5e971b491741e78a98ed131756a0f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:15.995453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1139/2285] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:15 2022] DELETE /identity/v3/users/3b5e971b491741e78a98ed131756a0f8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:16.006753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:16.007482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:16.007482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:16.028385 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:16.029716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:16.088919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1147/2286] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:16.099628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:16.101776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:16.168012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abd57a-c328-4670-affb-5213dbd21198 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:16.173777 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:16.174402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:16.174676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:16.174940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:16.186533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:16.187984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:16.198947 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1140/2287] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:16.487300 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:16.489276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:16.504422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e9a718-99dd-4181-b604-c2626073ffe8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:16.511265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:16.511835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:16.512053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:16.512409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] PATH_INFO: `/v3/projects/a2c4b717375445d4bdd352e7ab6c8260` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:16.513575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c4b717375445d4bdd352e7ab6c8260)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:16.515573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:16.534453 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:16.571946 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c4b717375445d4bdd352e7ab6c8260', 'request_id': 'req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.579352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c4b717375445d4bdd352e7ab6c8260', 'request_id': 'req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.588794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c4b717375445d4bdd352e7ab6c8260', 'request_id': 'req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.606312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] The token cache is being invalidate because project a2c4b717375445d4bdd352e7ab6c8260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:16.606577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.607296 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.609334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1148/2288] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:16 2022] DELETE /identity/v3/projects/a2c4b717375445d4bdd352e7ab6c8260 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:16.615624 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:16.633433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750fe6d-65c3-45fa-921a-eb8f3b4abfb6 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:16.683469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:16.705780 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:16.706479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:16.706699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:16.706967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] PATH_INFO: `/v3/users/d9447a984747460ab0f8fadbee077d22` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:16.708077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9447a984747460ab0f8fadbee077d22)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:16.710059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:16.761249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9447a984747460ab0f8fadbee077d22'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.774513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9447a984747460ab0f8fadbee077d22'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.775108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9447a984747460ab0f8fadbee077d22'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.784938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9447a984747460ab0f8fadbee077d22'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.785769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9447a984747460ab0f8fadbee077d22'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:16.799102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1141/2289] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:16 2022] DELETE /identity/v3/users/d9447a984747460ab0f8fadbee077d22 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:17.002289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:17.004955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:17.074966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eb6ac-7677-4d81-bd1b-cd3964d569c7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:17.134901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:17.135893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:17.135893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:17.136051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:17.138152 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:17.179216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:17.180911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:17.212728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:17.214221 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:17.224460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1149/2290] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:17.256849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b31344-a1f1-4840-9879-565eafc86c81 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:17.261820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:17.262456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:17.262767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:17.263008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] PATH_INFO: `/v3/projects/d2229ff5d51041ea8acc929398ef2c72` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:17.264259 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2229ff5d51041ea8acc929398ef2c72)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:17.266857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:17.321481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2229ff5d51041ea8acc929398ef2c72', 'request_id': 'req-da3d4de6-f5fe-452f-ba1f-935156df060e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.328197 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2229ff5d51041ea8acc929398ef2c72', 'request_id': 'req-da3d4de6-f5fe-452f-ba1f-935156df060e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.330675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:17.336507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2229ff5d51041ea8acc929398ef2c72', 'request_id': 'req-da3d4de6-f5fe-452f-ba1f-935156df060e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.351438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] The token cache is being invalidate because project d2229ff5d51041ea8acc929398ef2c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:17.351715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.352419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.353937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1142/2291] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:17 2022] DELETE /identity/v3/projects/d2229ff5d51041ea8acc929398ef2c72 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:17.357978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:17.370060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f0dc8-4832-48ee-ac02-dc04d86136ed service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:17.379590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:17.433294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:17.434291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:17.434585 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:17.434838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] PATH_INFO: `/v3/users/0484367f3706469a8f69c7db335354a0` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:17.436058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0484367f3706469a8f69c7db335354a0)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:17.438183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:17.485999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0484367f3706469a8f69c7db335354a0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.486586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0484367f3706469a8f69c7db335354a0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.487184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0484367f3706469a8f69c7db335354a0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.500575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0484367f3706469a8f69c7db335354a0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.508126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0484367f3706469a8f69c7db335354a0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.523826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1150/2292] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:17 2022] DELETE /identity/v3/users/0484367f3706469a8f69c7db335354a0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:17.714888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:17.717839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:17.743123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d4de6-f5fe-452f-ba1f-935156df060e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:17.860387 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:17.861037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:17.861331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:17.861786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] PATH_INFO: `/v3/users/87613cf4bf694750933928309c818934` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:17.863464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] RBAC: Authorizing `identity:delete_user(user_id=87613cf4bf694750933928309c818934)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:17.865522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:17.889917 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:17.891726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:17.942193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf4182-bd73-40e5-9c41-4039e7b2c074 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:17.947973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:17.948417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87613cf4bf694750933928309c818934'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.948606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:17.948848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:17.949126 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] PATH_INFO: `/v3/projects/b18cd85f4992467e8f6a737721a5d9c9` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:17.950293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18cd85f4992467e8f6a737721a5d9c9)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:17.953604 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:17.967359 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87613cf4bf694750933928309c818934'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.968551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87613cf4bf694750933928309c818934'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.981512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87613cf4bf694750933928309c818934'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:17.982516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-59f71a8c-6323-44f2-be21-4982b72c607b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87613cf4bf694750933928309c818934'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.000502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1143/2293] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:17 2022] DELETE /identity/v3/users/87613cf4bf694750933928309c818934 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:18.005058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.005480 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.005688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.016534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18cd85f4992467e8f6a737721a5d9c9', 'request_id': 'req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.025814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18cd85f4992467e8f6a737721a5d9c9', 'request_id': 'req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.030076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:18.031379 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.033237 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18cd85f4992467e8f6a737721a5d9c9', 'request_id': 'req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.050193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] The token cache is being invalidate because project b18cd85f4992467e8f6a737721a5d9c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:18.050438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.051072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-813a8552-f8e9-4e8f-95e2-8c85ba513e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.053433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1151/2294] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:17 2022] DELETE /identity/v3/projects/b18cd85f4992467e8f6a737721a5d9c9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:18.060103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2ecf-399a-48ad-a483-0494802fa782 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.060394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2ecf-399a-48ad-a483-0494802fa782 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.061510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd2ecf-399a-48ad-a483-0494802fa782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.085006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e2bd2ecf-399a-48ad-a483-0494802fa782 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:18.086520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e2bd2ecf-399a-48ad-a483-0494802fa782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.097053 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:18.116153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1144/2295] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:18.117252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.120327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.128181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:18.163001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1152/2296] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:18.165791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d64b6-c75d-44d8-92bf-d5cebb3ab61b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.166081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d64b6-c75d-44d8-92bf-d5cebb3ab61b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.166357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3d64b6-c75d-44d8-92bf-d5cebb3ab61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.190487 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cc3d64b6-c75d-44d8-92bf-d5cebb3ab61b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:18.191702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cc3d64b6-c75d-44d8-92bf-d5cebb3ab61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.200602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1153/2297] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:18.205136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d64b6-c75d-44d8-92bf-d5cebb3ab61b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.206028 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa5b6b-dc4e-41a4-b3df-e690213af1b3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.214866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3d64b6-c75d-44d8-92bf-d5cebb3ab61b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.215561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.216393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.216871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.217419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.219549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.220162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.220437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.220788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.222258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:18.222258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.223451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.230054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.232022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.240841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1154/2298] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:18.242750 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.248900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1145/2299] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:18.263881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a1323-e9c2-474d-8fbc-a628ccdf28f0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.269857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.270575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.270919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.271855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.272587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.274979 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.314315 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1155/2300] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:18.318561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.329176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bea2-36b3-48ec-8803-6a11367a9d7e service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.406026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.406637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.406914 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.407181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.407822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.409985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.436159 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1146/2301] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:18.440483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.450847 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9783-e574-4aee-84ae-7f1305a7064d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.455518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.456119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.456395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.456666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.457758 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.458934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.469136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1156/2302] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:18.473116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.484679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda1c0c-2518-4924-b363-cf67ad5acde1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.490411 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5940899-106a-4859-a81b-f9a42f85ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.491022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5940899-106a-4859-a81b-f9a42f85ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.491296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5940899-106a-4859-a81b-f9a42f85ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.491760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5940899-106a-4859-a81b-f9a42f85ea91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.492347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5940899-106a-4859-a81b-f9a42f85ea91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.494007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5940899-106a-4859-a81b-f9a42f85ea91 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.505069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1147/2303] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:18.509353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.519627 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5508e10-6d97-47ad-83e0-01c80994c860 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.525286 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.526057 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.526404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.526674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] PATH_INFO: `/v3/projects/7d9eda21d3404ee6bb22d6b6153cabd3/users/134b4ccb211d4ff09406d5f298fc4265/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.541922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9eda21d3404ee6bb22d6b6153cabd3, user_id=134b4ccb211d4ff09406d5f298fc4265, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.544578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.563313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1157/2304] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:18 2022] PUT /identity/v3/projects/7d9eda21d3404ee6bb22d6b6153cabd3/users/134b4ccb211d4ff09406d5f298fc4265/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:18.576465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.576747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.577283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.607913 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] MFA Rules not processed for user `134b4ccb211d4ff09406d5f298fc4265`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:18.609223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.683371 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1148/2305] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:18.689536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.699568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.701317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.725896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:18.784332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d1e96-b780-4384-99f3-bbe70b42b8f2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.789073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.789847 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.790343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.791098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] PATH_INFO: `/v3/projects/5e1b917dfbf44206b25eee65bea9d9c7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.791899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1b917dfbf44206b25eee65bea9d9c7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.793902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.794897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbe96-125f-4a07-afcf-311e1710e500 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.800066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.800801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.802293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.802293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.802293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.804252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.840424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1158/2306] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:18.846698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.860210 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1b917dfbf44206b25eee65bea9d9c7', 'request_id': 'req-73f3f541-52d3-4523-a3f0-616948953e7d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.869682 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1b917dfbf44206b25eee65bea9d9c7', 'request_id': 'req-73f3f541-52d3-4523-a3f0-616948953e7d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.877326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:18.878116 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1b917dfbf44206b25eee65bea9d9c7', 'request_id': 'req-73f3f541-52d3-4523-a3f0-616948953e7d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.899672 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] The token cache is being invalidate because project 5e1b917dfbf44206b25eee65bea9d9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:18.899963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.900607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:18.905099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1149/2307] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:18 2022] DELETE /identity/v3/projects/5e1b917dfbf44206b25eee65bea9d9c7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:18.906214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.908428 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.925904 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b388b89-8b93-4790-af76-7f7e513671f3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.932025 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.933125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.933512 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.934000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.934857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.937363 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.964822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1159/2308] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:18 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:18.965733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:18.967401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:18.979218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f541-52d3-4523-a3f0-616948953e7d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.980174 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8140597-940b-4138-87cf-d0c3e2a7849c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:18.984070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.984698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.984971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.985084 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:18.985274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] PATH_INFO: `/v3/users/ee15cb4ae5ad44bca1a80b9da646aab1` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.985603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:18.985879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:18.986277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:18.986469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee15cb4ae5ad44bca1a80b9da646aab1)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.986923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:18.988822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:18.988952 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.005812 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1160/2309] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:19.006780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.017058 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9186fc-dd84-4c6a-b513-308cb3662425 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.022810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.022810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.023090 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.023204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.023926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.025492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.037352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1161/2310] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:19.041352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.046297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee15cb4ae5ad44bca1a80b9da646aab1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.048009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:19.052109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75307032-6429-42af-981d-38d982a7e4f8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.057354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.057770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.058095 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.058444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] PATH_INFO: `/v3/projects/9e3412db07844fe3bfe74b23635ebeb8/users/6e8d33d7e97744558ab04c8335fb7087/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.063586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee15cb4ae5ad44bca1a80b9da646aab1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.064395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee15cb4ae5ad44bca1a80b9da646aab1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.074170 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee15cb4ae5ad44bca1a80b9da646aab1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.074709 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e3412db07844fe3bfe74b23635ebeb8, user_id=6e8d33d7e97744558ab04c8335fb7087, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.076137 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2ad0612c-2e71-49b9-9c87-b7ba6357f441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee15cb4ae5ad44bca1a80b9da646aab1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.078420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.094923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1150/2311] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:18 2022] DELETE /identity/v3/users/ee15cb4ae5ad44bca1a80b9da646aab1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:19.095199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1162/2312] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:19 2022] PUT /identity/v3/projects/9e3412db07844fe3bfe74b23635ebeb8/users/6e8d33d7e97744558ab04c8335fb7087/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:19.110139 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.110764 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.111521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.149472 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] MFA Rules not processed for user `6e8d33d7e97744558ab04c8335fb7087`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:19.151262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.243972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1151/2313] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:19.248467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.250540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.273415 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.275729 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.347006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b9025-607b-4b97-9586-4fe08e06ab25 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.416079 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.416708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.416989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.417263 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.417952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.420009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.445470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:19.457852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1163/2314] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:19 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:19.459889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.492215 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9032544-7673-49b8-84f7-bf7f1b408ac8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.578918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:19.593660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c86c57-edcc-4633-b0d6-d5d2d81dba56 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.601089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.601745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.602050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.602289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.603110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.605156 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.613942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.615048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.615702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.616324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.618505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.637862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1164/2315] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:19 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:19.639117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.641028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.656959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f66c-27fc-43f0-add4-27af846d62aa admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.664580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.665162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.666596 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.666724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.666953 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.667222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] PATH_INFO: `/v3/projects/7752d8546d4b4c9f9deaa26aee19404e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.668810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7752d8546d4b4c9f9deaa26aee19404e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.671653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.681008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1152/2316] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:19.682176 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.695508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f39eb-40f9-42cc-930b-b774c87531ec service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.701890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.702651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.702930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.705231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.706060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.707981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.732341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1153/2317] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:19.733368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.749041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7752d8546d4b4c9f9deaa26aee19404e', 'request_id': 'req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.750519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8b9fe-1e43-4ab9-bcf3-79b9f812ccd7 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.760535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7752d8546d4b4c9f9deaa26aee19404e', 'request_id': 'req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.767729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7752d8546d4b4c9f9deaa26aee19404e', 'request_id': 'req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.791889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] The token cache is being invalidate because project 7752d8546d4b4c9f9deaa26aee19404e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:19.792447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.793885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8acb13e-f8da-4a50-8d01-6c8d0d2ab3d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:19.798086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1165/2318] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:19 2022] DELETE /identity/v3/projects/7752d8546d4b4c9f9deaa26aee19404e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:19.806314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab56e19-aacb-4ced-8c52-8ab90852cbc7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.808129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab56e19-aacb-4ced-8c52-8ab90852cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.808129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab56e19-aacb-4ced-8c52-8ab90852cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.845534 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-5ab56e19-aacb-4ced-8c52-8ab90852cbc7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:19.847450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.848885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5ab56e19-aacb-4ced-8c52-8ab90852cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.850138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.850413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.850683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] PATH_INFO: `/v3/projects/f795aeb7fb1b4561b00c80852214279d/users/2b65a0a28a404394a2583e3ea62940ed/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.869623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1166/2319] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:19.871349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af58b4-43e0-4394-a28a-6a2785dcb31e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.871633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af58b4-43e0-4394-a28a-6a2785dcb31e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.871958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af58b4-43e0-4394-a28a-6a2785dcb31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:19.877318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f795aeb7fb1b4561b00c80852214279d, user_id=2b65a0a28a404394a2583e3ea62940ed, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:19.880234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:19.894984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-95af58b4-43e0-4394-a28a-6a2785dcb31e None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:19.896217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-95af58b4-43e0-4394-a28a-6a2785dcb31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.897183 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1154/2320] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:19 2022] PUT /identity/v3/projects/f795aeb7fb1b4561b00c80852214279d/users/2b65a0a28a404394a2583e3ea62940ed/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:19.901220 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.903943 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:19.981498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1167/2321] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:19.986831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af58b4-43e0-4394-a28a-6a2785dcb31e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:19.989755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6be066-7f22-4876-9044-0e76e7fcb55d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.994490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:19.997790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:19.998534 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:19.998906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:19.999089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af58b4-43e0-4394-a28a-6a2785dcb31e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:19.999538 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.000588 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.003007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.005461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.006421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.007314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.008938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.009924 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:20.011629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.015452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.020264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1155/2322] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:20.024976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.037625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1168/2323] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:20.038963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.043629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b153c-b11e-48de-b421-52853cb47ca8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.050930 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d44aea-afac-45ea-b034-7758752bbe7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.052331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d44aea-afac-45ea-b034-7758752bbe7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.052712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d44aea-afac-45ea-b034-7758752bbe7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.053087 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d44aea-afac-45ea-b034-7758752bbe7b admin admin] PATH_INFO: `/v3/projects/f795aeb7fb1b4561b00c80852214279d/users/2b65a0a28a404394a2583e3ea62940ed/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.054670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09c44b-1185-41b9-8f40-f51f736579a7 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.055810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d44aea-afac-45ea-b034-7758752bbe7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f795aeb7fb1b4561b00c80852214279d, user_id=2b65a0a28a404394a2583e3ea62940ed, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.059370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d44aea-afac-45ea-b034-7758752bbe7b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.062754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.063421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.063700 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.063970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.065821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.068256 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.075391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1156/2324] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:20 2022] PUT /identity/v3/projects/f795aeb7fb1b4561b00c80852214279d/users/2b65a0a28a404394a2583e3ea62940ed/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:20.086003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.086426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.086823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.106417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1169/2325] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:20 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:20.109171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.121507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] MFA Rules not processed for user `2b65a0a28a404394a2583e3ea62940ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:20.123189 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:20.151614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:20.200196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d656696-8fc1-419c-ac1f-0b7b82413655 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.206677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.207308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.207589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.207856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.208493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.211593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.227811 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1157/2326] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:20.237727 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.239625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:20.252353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1170/2327] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:20 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:20.256805 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.277030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005e9a4-dae8-4464-aa76-d69a3ce6dada admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.283439 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.284065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.284501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.284770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.286307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.289012 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.307157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1171/2328] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:20.312211 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.319618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ac68c-610c-4e2f-b042-f83764bc30bc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.324462 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d95c2-b1d6-4834-8f5a-48d387ee7985 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.325334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.326058 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.327001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.327341 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.329818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.330587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.330877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.331340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.332132 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.333988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.339705 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.342001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.349418 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1172/2329] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:20.354639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.355445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1158/2330] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:20.366762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d6fbc-2072-47a6-92b0-29b936ac5160 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.371580 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddc943-f059-4d9c-94bf-e29072b03cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.372353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc943-f059-4d9c-94bf-e29072b03cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.372879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc943-f059-4d9c-94bf-e29072b03cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.373027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc943-f059-4d9c-94bf-e29072b03cdb admin admin] PATH_INFO: `/v3/projects/1455b2484eaf4aa59f7627116e5ec357/users/d3b4cd8fb9cf4b508f5a7d6363219ccc/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.394343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddc943-f059-4d9c-94bf-e29072b03cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1455b2484eaf4aa59f7627116e5ec357, user_id=d3b4cd8fb9cf4b508f5a7d6363219ccc, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.397209 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddc943-f059-4d9c-94bf-e29072b03cdb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.414518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.416384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:20.425959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1173/2331] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:20 2022] PUT /identity/v3/projects/1455b2484eaf4aa59f7627116e5ec357/users/d3b4cd8fb9cf4b508f5a7d6363219ccc/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:20.430051 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de42640-c369-4c13-80e6-a5f1f7edf644 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.432447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf982cc-8f08-499d-8a13-23a9b23d5ac6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.432790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf982cc-8f08-499d-8a13-23a9b23d5ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.433116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf982cc-8f08-499d-8a13-23a9b23d5ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.473161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4bf982cc-8f08-499d-8a13-23a9b23d5ac6 None None] MFA Rules not processed for user `d3b4cd8fb9cf4b508f5a7d6363219ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:20.474923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4bf982cc-8f08-499d-8a13-23a9b23d5ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:20.503055 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.504389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.504771 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.505646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.508575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:20.578827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1174/2332] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:20.585295 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf982cc-8f08-499d-8a13-23a9b23d5ac6 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.587062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.589403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.594558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:20.605795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1159/2333] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:20.694836 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf982cc-8f08-499d-8a13-23a9b23d5ac6 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.700186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.700822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.701167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.701441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.702185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.705877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.754050 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1175/2334] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:20 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:20.759704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.782059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fcac3-a3f6-48e1-abc2-979fff228383 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.802616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:20.880795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.882712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.883169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.883588 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.884416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.886798 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.942032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1160/2335] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:20 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:20.943653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:20.956486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22666692-3bd4-41e3-94e3-0a181f27dc97 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:20.965213 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:20.966125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:20.966696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:20.967987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:20.968786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:20.973731 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:20.988388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1176/2336] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:20.992657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:21.005205 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ccdf-5203-46de-8745-3b5e40a76131 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:21.010496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:21.011168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:21.011441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:21.011944 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] PATH_INFO: `/v3/projects/842198c8a35d43339850cdf8f5e756b5/users/ecfb788d6e444392936fb43516ed6728/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:21.037370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842198c8a35d43339850cdf8f5e756b5, user_id=ecfb788d6e444392936fb43516ed6728, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:21.040076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:21.061417 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1161/2337] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:20 2022] PUT /identity/v3/projects/842198c8a35d43339850cdf8f5e756b5/users/ecfb788d6e444392936fb43516ed6728/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:21.067141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:21.087001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b460ac-6219-4612-89b4-92781f0c4d94 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:21.197906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2703720-3e7f-4c88-8ec4-8033a11dc076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:21.198586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2703720-3e7f-4c88-8ec4-8033a11dc076 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:21.198797 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2703720-3e7f-4c88-8ec4-8033a11dc076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:21.199064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2703720-3e7f-4c88-8ec4-8033a11dc076 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:21.199718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2703720-3e7f-4c88-8ec4-8033a11dc076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:21.201326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2703720-3e7f-4c88-8ec4-8033a11dc076 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:21.213231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1177/2338] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:21.217803 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:21.229325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d219807-6008-4632-a9b8-85d3ca3405e1 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:21.234218 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:21.234966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:21.235315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:21.235650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] PATH_INFO: `/v3/projects/842198c8a35d43339850cdf8f5e756b5/users/ecfb788d6e444392936fb43516ed6728/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:21.238200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=842198c8a35d43339850cdf8f5e756b5, user_id=ecfb788d6e444392936fb43516ed6728, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:21.240826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:21.252903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1162/2339] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:21 2022] PUT /identity/v3/projects/842198c8a35d43339850cdf8f5e756b5/users/ecfb788d6e444392936fb43516ed6728/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:21.264443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616416-97d2-473f-9bb1-f924a7f2a8b0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:21.264871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616416-97d2-473f-9bb1-f924a7f2a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:21.265148 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4616416-97d2-473f-9bb1-f924a7f2a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:21.297879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f4616416-97d2-473f-9bb1-f924a7f2a8b0 None None] MFA Rules not processed for user `ecfb788d6e444392936fb43516ed6728`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:21.300229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f4616416-97d2-473f-9bb1-f924a7f2a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:21.395728 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:21.425549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:21.426842 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1178/2340] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:21.493429 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28079b35-9bca-448a-b931-105fd66bc953 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:21.497322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:21.497957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:21.498235 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:21.498502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:21.511140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:21.514060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:21.528214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1163/2341] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:21.675762 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616416-97d2-473f-9bb1-f924a7f2a8b0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:21.691661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4616416-97d2-473f-9bb1-f924a7f2a8b0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:21.695704 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f842d7-fc58-4fbc-afce-d1134bd88f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:21.696378 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f842d7-fc58-4fbc-afce-d1134bd88f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:21.696685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f842d7-fc58-4fbc-afce-d1134bd88f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:21.696954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f842d7-fc58-4fbc-afce-d1134bd88f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:21.763825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f842d7-fc58-4fbc-afce-d1134bd88f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:21.765678 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f842d7-fc58-4fbc-afce-d1134bd88f24 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:21.775918 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1179/2342] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:23.821906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:23.899662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cd41a5-19d0-44b7-95f5-c1ec4871e58d service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:23.905272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:23.905924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:23.906204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:23.906478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] PATH_INFO: `/v3/users/134b4ccb211d4ff09406d5f298fc4265` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:23.907658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134b4ccb211d4ff09406d5f298fc4265)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:23.909616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:23.922151 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:23.958339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134b4ccb211d4ff09406d5f298fc4265'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:23.972958 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134b4ccb211d4ff09406d5f298fc4265'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:23.973853 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134b4ccb211d4ff09406d5f298fc4265'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:23.982506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134b4ccb211d4ff09406d5f298fc4265'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:23.983193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134b4ccb211d4ff09406d5f298fc4265'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:23.998376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1164/2343] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:23 2022] DELETE /identity/v3/users/134b4ccb211d4ff09406d5f298fc4265 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:24.003241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:24.003770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:24.003881 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:24.024729 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:24.026118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.094154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1180/2344] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:24.106180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:24.107909 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.174916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a72fa-bd4e-4769-848c-65f0f03ad713 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:24.179992 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:24.180626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:24.180905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:24.181830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:24.192976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:24.194453 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:24.204535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1165/2345] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:24.433844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:24.433844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.447583 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0bb18-7422-4bf0-bb65-aea48ad9dc14 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:24.454653 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:24.455502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:24.455968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:24.456404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] PATH_INFO: `/v3/users/d3b4cd8fb9cf4b508f5a7d6363219ccc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:24.457900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b4cd8fb9cf4b508f5a7d6363219ccc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:24.460267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:24.518606 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b4cd8fb9cf4b508f5a7d6363219ccc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.519412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b4cd8fb9cf4b508f5a7d6363219ccc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.520106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b4cd8fb9cf4b508f5a7d6363219ccc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.534841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b4cd8fb9cf4b508f5a7d6363219ccc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.542790 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3cbf4412-4212-44f6-bdb2-8ca016880634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b4cd8fb9cf4b508f5a7d6363219ccc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.551525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:24.553824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.570936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1181/2346] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:24 2022] DELETE /identity/v3/users/d3b4cd8fb9cf4b508f5a7d6363219ccc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:24.579049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:24.579579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:24.580501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:24.587167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d38e7-78b5-4fe9-b529-973659833a50 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:24.610894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:24.613140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.618705 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:24.663983 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:24.664971 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:24.665431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:24.665711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] PATH_INFO: `/v3/projects/7d9eda21d3404ee6bb22d6b6153cabd3` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:24.666839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9eda21d3404ee6bb22d6b6153cabd3)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:24.668744 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:24.681230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1182/2347] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:24.691049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:24.692550 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.707261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:24.721107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9eda21d3404ee6bb22d6b6153cabd3', 'request_id': 'req-387b4e1d-e230-4419-949c-c646f0622e04'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.727856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9eda21d3404ee6bb22d6b6153cabd3', 'request_id': 'req-387b4e1d-e230-4419-949c-c646f0622e04'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.733871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9eda21d3404ee6bb22d6b6153cabd3', 'request_id': 'req-387b4e1d-e230-4419-949c-c646f0622e04'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.747561 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] The token cache is being invalidate because project 7d9eda21d3404ee6bb22d6b6153cabd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:24.747876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.748575 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.750109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1166/2348] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:24 2022] DELETE /identity/v3/projects/7d9eda21d3404ee6bb22d6b6153cabd3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:24.754067 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:24.755418 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.756362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c796de-635c-4913-95b2-e88deef70d68 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:24.804629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:24.805236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:24.805554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:24.805843 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:24.807619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:24.822557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b4e1d-e230-4419-949c-c646f0622e04 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:24.827921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:24.828554 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:24.828833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:24.829108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] PATH_INFO: `/v3/users/6e8d33d7e97744558ab04c8335fb7087` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:24.830283 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8d33d7e97744558ab04c8335fb7087)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:24.832233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:24.880877 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:24.881869 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8d33d7e97744558ab04c8335fb7087'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.882278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:24.891887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1183/2349] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:24.894269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8d33d7e97744558ab04c8335fb7087'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.894953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8d33d7e97744558ab04c8335fb7087'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.902080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8d33d7e97744558ab04c8335fb7087'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.902753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8d33d7e97744558ab04c8335fb7087'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:24.917015 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1167/2350] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:24 2022] DELETE /identity/v3/users/6e8d33d7e97744558ab04c8335fb7087 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:25.255116 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:25.256630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:25.270773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa099b4-ec57-4467-a71e-a06b1b1d2c2f service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:25.287422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:25.306849 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:25.308337 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:25.345506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:25.346173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:25.346458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:25.346992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] PATH_INFO: `/v3/projects/1455b2484eaf4aa59f7627116e5ec357` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:25.348609 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1455b2484eaf4aa59f7627116e5ec357)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:25.350662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:25.359718 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:25.383438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1e472-3d64-4a5a-b2fd-1e906288e554 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:25.387890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:25.388513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:25.388791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:25.389256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] PATH_INFO: `/v3/projects/9e3412db07844fe3bfe74b23635ebeb8` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:25.390324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e3412db07844fe3bfe74b23635ebeb8)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:25.392234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:25.401193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1455b2484eaf4aa59f7627116e5ec357', 'request_id': 'req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.409928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1455b2484eaf4aa59f7627116e5ec357', 'request_id': 'req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.415694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1455b2484eaf4aa59f7627116e5ec357', 'request_id': 'req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.432685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] The token cache is being invalidate because project 1455b2484eaf4aa59f7627116e5ec357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:25.433141 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.434074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.436549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1184/2351] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:25 2022] DELETE /identity/v3/projects/1455b2484eaf4aa59f7627116e5ec357 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:25.440858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:25.443104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:25.449989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e3412db07844fe3bfe74b23635ebeb8', 'request_id': 'req-f19eb311-e80e-40aa-b8d1-a5e930337545'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.458245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e3412db07844fe3bfe74b23635ebeb8', 'request_id': 'req-f19eb311-e80e-40aa-b8d1-a5e930337545'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.465689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e3412db07844fe3bfe74b23635ebeb8', 'request_id': 'req-f19eb311-e80e-40aa-b8d1-a5e930337545'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.485140 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] The token cache is being invalidate because project 9e3412db07844fe3bfe74b23635ebeb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:25.485510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.486308 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.488598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1168/2352] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:25 2022] DELETE /identity/v3/projects/9e3412db07844fe3bfe74b23635ebeb8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:25.493125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:25.495524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:25.545005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca4c60-d3c4-45bf-985a-74bb8a9eff3d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:25.587894 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eb311-e80e-40aa-b8d1-a5e930337545 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:25.593467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:25.594126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:25.594401 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:25.594670 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] PATH_INFO: `/v3/users/2b65a0a28a404394a2583e3ea62940ed` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:25.595846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b65a0a28a404394a2583e3ea62940ed)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:25.597795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:25.612985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:25.629061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:25.629763 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:25.630109 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:25.630356 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] PATH_INFO: `/v3/users/ecfb788d6e444392936fb43516ed6728` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:25.632629 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfb788d6e444392936fb43516ed6728)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:25.636339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:25.649505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b65a0a28a404394a2583e3ea62940ed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.664618 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b65a0a28a404394a2583e3ea62940ed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.666172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b65a0a28a404394a2583e3ea62940ed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.679402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b65a0a28a404394a2583e3ea62940ed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.680578 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b65a0a28a404394a2583e3ea62940ed'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.684620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:25.697419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfb788d6e444392936fb43516ed6728'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.698404 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfb788d6e444392936fb43516ed6728'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.699018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfb788d6e444392936fb43516ed6728'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.700774 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1169/2353] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:25 2022] DELETE /identity/v3/users/2b65a0a28a404394a2583e3ea62940ed => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:25.701788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:25.704689 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:25.718866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfb788d6e444392936fb43516ed6728'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.726977 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfb788d6e444392936fb43516ed6728'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:25.742655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1185/2354] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:25 2022] DELETE /identity/v3/users/ecfb788d6e444392936fb43516ed6728 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:25.784547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e628f74-e2b9-42fa-875b-641a7737e51b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:25.859850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940df3cd-bcaa-41d9-861f-4199799ff9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:25.860565 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df3cd-bcaa-41d9-861f-4199799ff9ad service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:25.860794 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df3cd-bcaa-41d9-861f-4199799ff9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:25.861115 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df3cd-bcaa-41d9-861f-4199799ff9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:25.863502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-940df3cd-bcaa-41d9-861f-4199799ff9ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:25.933331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940df3cd-bcaa-41d9-861f-4199799ff9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:25.935189 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940df3cd-bcaa-41d9-861f-4199799ff9ad service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:25.949775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1170/2355] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:26.054454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.056005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.069776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea93c0-254f-4dee-b25c-8b4588532449 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.074751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.075434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.075807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.076151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] PATH_INFO: `/v3/projects/f795aeb7fb1b4561b00c80852214279d` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.077657 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f795aeb7fb1b4561b00c80852214279d)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.079493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.130212 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f795aeb7fb1b4561b00c80852214279d', 'request_id': 'req-52263405-01d5-4345-b12d-3f6e523b6dd2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.137336 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f795aeb7fb1b4561b00c80852214279d', 'request_id': 'req-52263405-01d5-4345-b12d-3f6e523b6dd2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.143294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f795aeb7fb1b4561b00c80852214279d', 'request_id': 'req-52263405-01d5-4345-b12d-3f6e523b6dd2'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.157816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] The token cache is being invalidate because project f795aeb7fb1b4561b00c80852214279d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:26.158400 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.159062 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.160573 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1186/2356] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:26 2022] DELETE /identity/v3/projects/f795aeb7fb1b4561b00c80852214279d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:26.166791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557afa89-9c04-40f8-9dd2-0ec47a2c833c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.167153 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557afa89-9c04-40f8-9dd2-0ec47a2c833c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.167496 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557afa89-9c04-40f8-9dd2-0ec47a2c833c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.195098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-557afa89-9c04-40f8-9dd2-0ec47a2c833c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:26.196323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-557afa89-9c04-40f8-9dd2-0ec47a2c833c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.255296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:26.269419 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.271513 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.273710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1171/2357] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:26.281256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e82d6-b60a-422a-b9ce-5e71e2cb0dd5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.281649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e82d6-b60a-422a-b9ce-5e71e2cb0dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.282391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e82d6-b60a-422a-b9ce-5e71e2cb0dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.291434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263405-01d5-4345-b12d-3f6e523b6dd2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.298972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.300155 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.300579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.300947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] PATH_INFO: `/v3/projects/842198c8a35d43339850cdf8f5e756b5` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.302329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842198c8a35d43339850cdf8f5e756b5)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.305094 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.315829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0c8e82d6-b60a-422a-b9ce-5e71e2cb0dd5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:26.318252 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0c8e82d6-b60a-422a-b9ce-5e71e2cb0dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.328420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1172/2358] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:26.333673 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e82d6-b60a-422a-b9ce-5e71e2cb0dd5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.343862 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e82d6-b60a-422a-b9ce-5e71e2cb0dd5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.349761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.350708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.351096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.351457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.352108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:26.352460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.354142 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.365235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842198c8a35d43339850cdf8f5e756b5', 'request_id': 'req-7152b153-fed5-461e-a9a7-56de5ba6be55'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.366959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:26.367721 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1173/2359] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:26.372344 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.377421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842198c8a35d43339850cdf8f5e756b5', 'request_id': 'req-7152b153-fed5-461e-a9a7-56de5ba6be55'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.384060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b0b0b-a9dd-4211-b703-ce01b6c3dddb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.385830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842198c8a35d43339850cdf8f5e756b5', 'request_id': 'req-7152b153-fed5-461e-a9a7-56de5ba6be55'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.399992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] The token cache is being invalidate because project 842198c8a35d43339850cdf8f5e756b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:26.400203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.400939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-7152b153-fed5-461e-a9a7-56de5ba6be55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:26.402825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1187/2360] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:26 2022] DELETE /identity/v3/projects/842198c8a35d43339850cdf8f5e756b5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:26.407887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc00c81-ba39-4546-adb3-be36ec76c505 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.408171 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc00c81-ba39-4546-adb3-be36ec76c505 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.408457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc00c81-ba39-4546-adb3-be36ec76c505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.430074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7bc00c81-ba39-4546-adb3-be36ec76c505 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:26.431980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7bc00c81-ba39-4546-adb3-be36ec76c505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.454277 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.454650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.455293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.456191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.456191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.458368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.497978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1174/2361] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:26.498760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.500393 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.502770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1188/2362] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:26.510692 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8faf-6ce1-4da2-9517-1405c67b3945 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.510978 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8faf-6ce1-4da2-9517-1405c67b3945 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.511251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba8faf-6ce1-4da2-9517-1405c67b3945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.531696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-26ba8faf-6ce1-4da2-9517-1405c67b3945 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:26.532925 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-26ba8faf-6ce1-4da2-9517-1405c67b3945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.575918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2be706-dfbc-43ac-9e0c-197be81a2f80 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.582069 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.583145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.583522 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.583893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.584755 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.586977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.601915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1189/2363] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:26.606158 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba8faf-6ce1-4da2-9517-1405c67b3945 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.614925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1175/2364] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:26.618646 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba8faf-6ce1-4da2-9517-1405c67b3945 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.619720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.624227 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.625009 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.625351 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.625730 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.626476 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:26.626854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.628551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.631370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe13584-8230-4322-a399-dbfd3fd9486e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.636130 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.636805 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.637156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.637542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.638257 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.640026 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.641907 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1190/2365] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:04:26.645852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.655419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1176/2366] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:26.656875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.657197 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281627e-45e2-4683-b002-32a11248bc0b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.662195 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.662801 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.663081 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.663355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.663988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.665959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.670698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b82df-0bcd-45ce-ba9a-4779d2c18b8a admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.676007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.676523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.676808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.677078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.678327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.680851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.693826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1177/2367] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:26.698563 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.699974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1191/2368] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:26.706441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.717444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b873586-69f6-485a-aaef-c74caf9642db admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.759427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:26.770376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:26.796674 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751838a8-f696-4951-a87e-090d4a58ce1c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.800350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21555636-cb24-46b2-9ab0-ed3a78fee800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.801198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21555636-cb24-46b2-9ab0-ed3a78fee800 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.801591 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21555636-cb24-46b2-9ab0-ed3a78fee800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.802536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21555636-cb24-46b2-9ab0-ed3a78fee800 admin admin] PATH_INFO: `/v3/projects/9b17133bb7d14853a02393a324e994f8/users/d3c5c3558dcf48a5ac76ab519969f9d6/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.802695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.802695 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.803040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.803379 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.804386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.807944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.825194 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21555636-cb24-46b2-9ab0-ed3a78fee800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b17133bb7d14853a02393a324e994f8, user_id=d3c5c3558dcf48a5ac76ab519969f9d6, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.828457 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21555636-cb24-46b2-9ab0-ed3a78fee800 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.837744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1192/2369] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:26.845305 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.849475 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1178/2370] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:26 2022] PUT /identity/v3/projects/9b17133bb7d14853a02393a324e994f8/users/d3c5c3558dcf48a5ac76ab519969f9d6/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:26.856615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfeb827-d18e-4f2b-8931-fe6def0048ae admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.920887 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.921732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.922016 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.935968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.936745 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.937119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.937520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.938303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.939965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.953446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1193/2371] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:26.954698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:26.956784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] MFA Rules not processed for user `d3c5c3558dcf48a5ac76ab519969f9d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:26.957512 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:26.966309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1fff8-9ae7-4ddf-8351-9fdcaa9f4a55 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:26.971485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:26.972110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:26.972575 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:26.972854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:26.973636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:26.975254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:26.990537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1194/2372] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:26.991661 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.003231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbaed3-7e83-4dc4-9a74-b969222649e5 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.009565 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d234dd-6589-4411-ba27-e7cf6e5b436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.010497 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d234dd-6589-4411-ba27-e7cf6e5b436b admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.010783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d234dd-6589-4411-ba27-e7cf6e5b436b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.011048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d234dd-6589-4411-ba27-e7cf6e5b436b admin admin] PATH_INFO: `/v3/projects/535b81e13f5a46c5917758a93a93af84/users/619969a0a4df4c54ab4c05bf8c48b60e/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.026673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d234dd-6589-4411-ba27-e7cf6e5b436b admin admin] RBAC: Authorizing `identity:create_grant(project_id=535b81e13f5a46c5917758a93a93af84, user_id=619969a0a4df4c54ab4c05bf8c48b60e, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.029521 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d234dd-6589-4411-ba27-e7cf6e5b436b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.039225 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1179/2373] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:27.048125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1195/2374] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:26 2022] PUT /identity/v3/projects/535b81e13f5a46c5917758a93a93af84/users/619969a0a4df4c54ab4c05bf8c48b60e/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:27.048329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.049707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:27.060956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7d4e3-bf81-4395-8d0f-54987d2be668 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.061324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7d4e3-bf81-4395-8d0f-54987d2be668 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.061684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7d4e3-bf81-4395-8d0f-54987d2be668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.090278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c9d7d4e3-bf81-4395-8d0f-54987d2be668 None None] MFA Rules not processed for user `619969a0a4df4c54ab4c05bf8c48b60e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:27.091642 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c9d7d4e3-bf81-4395-8d0f-54987d2be668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:27.126488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf3fab-2358-4c07-979c-b3ca31c1929c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.171235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1196/2375] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:27.172274 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7d4e3-bf81-4395-8d0f-54987d2be668 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.183244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.184477 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.184836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.185298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.199452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:27.208459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:27.265607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7d4e3-bf81-4395-8d0f-54987d2be668 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.269063 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.270640 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.271307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.271724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.271997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.272340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.272685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.274697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.285263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1180/2376] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:27.312432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1197/2377] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:27 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:27.316577 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.316726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.330023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5b4f-10fa-4b7d-8ec7-deae4c2b0f7b service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.393707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24edfdc-d963-4863-bb08-0c7eb7d14e9a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.404684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.406594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.407047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.407224 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.407631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.407877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.408216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.408551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] PATH_INFO: `/v3/users/d3c5c3558dcf48a5ac76ab519969f9d6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.408923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.409896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c5c3558dcf48a5ac76ab519969f9d6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.411605 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.411987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.438952 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1198/2378] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:27 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:27.442754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.459724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b16310-1fd0-4760-b2e6-bdeb26b602f0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.466186 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.467320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.467320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.467597 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.468303 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.470815 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.481034 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c5c3558dcf48a5ac76ab519969f9d6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:27.487357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1199/2379] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:27.488834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.496419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c5c3558dcf48a5ac76ab519969f9d6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:27.497219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c5c3558dcf48a5ac76ab519969f9d6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:27.501267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccc58d-3ab4-49d1-8dda-0377cacac031 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.506807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c5c3558dcf48a5ac76ab519969f9d6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:27.507045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.507665 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-96954a5b-51ff-48cb-97cb-db359f3e024e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c5c3558dcf48a5ac76ab519969f9d6'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:27.507926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.508493 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.508717 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.509324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.511361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.531454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1181/2381] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:27 2022] DELETE /identity/v3/users/d3c5c3558dcf48a5ac76ab519969f9d6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:27.531686 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1200/2381] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:27.533721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.534033 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.534386 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.534760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.536003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:27.555696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da034c-bffb-4607-ad20-390a72b4e44d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.560525 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:27.562121 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:27.601997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:27.641824 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda17101-110b-491d-ab67-d4d7cb13308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.642852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17101-110b-491d-ab67-d4d7cb13308f admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.643187 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17101-110b-491d-ab67-d4d7cb13308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.643541 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda17101-110b-491d-ab67-d4d7cb13308f admin admin] PATH_INFO: `/v3/projects/0f384cea364d42d1b604a99a8ab44eab/users/faddc6e074944829ad2ddbd52c9d75fe/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.649987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1182/2382] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:27.661209 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.662871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:27.667851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda17101-110b-491d-ab67-d4d7cb13308f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f384cea364d42d1b604a99a8ab44eab, user_id=faddc6e074944829ad2ddbd52c9d75fe, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.673702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda17101-110b-491d-ab67-d4d7cb13308f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.694987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:27.704454 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1201/2383] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:27 2022] PUT /identity/v3/projects/0f384cea364d42d1b604a99a8ab44eab/users/faddc6e074944829ad2ddbd52c9d75fe/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:27.716442 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8ccd-34a9-4889-8536-0b480a0111c0 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.716800 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8ccd-34a9-4889-8536-0b480a0111c0 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.717594 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb8ccd-34a9-4889-8536-0b480a0111c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.751912 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-09fb8ccd-34a9-4889-8536-0b480a0111c0 None None] MFA Rules not processed for user `faddc6e074944829ad2ddbd52c9d75fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:27.752389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217c48f-82c1-46be-a5da-3f8c93373eb1 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.753183 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-09fb8ccd-34a9-4889-8536-0b480a0111c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:27.831031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.831699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.831979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.832244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.842066 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1202/2384] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:27.847194 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb8ccd-34a9-4889-8536-0b480a0111c0 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:27.940194 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.942007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:27.950545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb8ccd-34a9-4889-8536-0b480a0111c0 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:27.960981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1183/2385] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:27.962421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:27.963061 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:27.963326 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:27.963598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:27.964245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:27.966276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.012587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1203/2386] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:27 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:28.014342 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.032807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b80e3c-74ee-412a-8a29-313770e6fe78 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.138303 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:28.178398 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.179041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.179323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.179592 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.180236 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.182262 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.235396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1184/2387] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:28 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:28.236123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.252173 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18648b2-e7c1-421d-80c4-2c6bf616aa95 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.258165 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.260417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.260897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.261372 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.262225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.264344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.281106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1204/2388] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:28.287304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.302169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc2466-b5bd-476a-afab-d3a91b2cf1aa admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.308808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.310335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.310763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.311132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] PATH_INFO: `/v3/projects/4e0825c637bc4677a13092453d7fb77f/users/a06ab9953e344cf1a38632048d47ee6e/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.334481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0825c637bc4677a13092453d7fb77f, user_id=a06ab9953e344cf1a38632048d47ee6e, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.337264 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.356590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1185/2389] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:28 2022] PUT /identity/v3/projects/4e0825c637bc4677a13092453d7fb77f/users/a06ab9953e344cf1a38632048d47ee6e/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:28.361702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.380557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5c50-7d18-46ff-898b-8ff22615ea68 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.456913 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.457578 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.457897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.458120 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.459145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.460780 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.467996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:28.473228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1205/2390] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:28.478190 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.512602 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4d294-3a01-43b5-8b08-401a69e127a9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.521294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.523484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:28.525691 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d3d6c-73aa-41aa-95a2-2c1f0717b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.527409 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3d6c-73aa-41aa-95a2-2c1f0717b18e admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.527845 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3d6c-73aa-41aa-95a2-2c1f0717b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.528444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d3d6c-73aa-41aa-95a2-2c1f0717b18e admin admin] PATH_INFO: `/v3/projects/4e0825c637bc4677a13092453d7fb77f/users/a06ab9953e344cf1a38632048d47ee6e/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.531071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3d6c-73aa-41aa-95a2-2c1f0717b18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0825c637bc4677a13092453d7fb77f, user_id=a06ab9953e344cf1a38632048d47ee6e, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.534669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d3d6c-73aa-41aa-95a2-2c1f0717b18e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.549936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6ef8b-d2d6-4b38-832c-c02be64fbeab admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.556979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1186/2391] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:28 2022] PUT /identity/v3/projects/4e0825c637bc4677a13092453d7fb77f/users/a06ab9953e344cf1a38632048d47ee6e/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:28.568827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.569103 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.569373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.620148 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] MFA Rules not processed for user `a06ab9953e344cf1a38632048d47ee6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:28.622049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:28.651863 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.652584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.652886 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.653154 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] PATH_INFO: `/v3/projects/9b17133bb7d14853a02393a324e994f8` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.654582 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b17133bb7d14853a02393a324e994f8)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.656639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.729539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b17133bb7d14853a02393a324e994f8', 'request_id': 'req-8cc42399-edcc-4186-a032-5ab085aab4a8'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:28.741617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b17133bb7d14853a02393a324e994f8', 'request_id': 'req-8cc42399-edcc-4186-a032-5ab085aab4a8'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:28.742488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1187/2392] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:28.750718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b17133bb7d14853a02393a324e994f8', 'request_id': 'req-8cc42399-edcc-4186-a032-5ab085aab4a8'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:28.755263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.757127 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:28.772387 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] The token cache is being invalidate because project 9b17133bb7d14853a02393a324e994f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:28.773131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:28.773901 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8cc42399-edcc-4186-a032-5ab085aab4a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:28.775469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1206/2393] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:28 2022] DELETE /identity/v3/projects/9b17133bb7d14853a02393a324e994f8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:28.780839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006658c-d571-4c77-99a2-e1b85e9604b6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.781123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006658c-d571-4c77-99a2-e1b85e9604b6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.781408 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4006658c-d571-4c77-99a2-e1b85e9604b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.822451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-4006658c-d571-4c77-99a2-e1b85e9604b6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:28.824072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-4006658c-d571-4c77-99a2-e1b85e9604b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:28.841637 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385b42-7800-48c4-957b-9d4375326f54 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.884761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:28.892866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1207/2394] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:28.901838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55b75-34b9-4ac6-9a27-0bd2420e3d9a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.902759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55b75-34b9-4ac6-9a27-0bd2420e3d9a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.903242 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc55b75-34b9-4ac6-9a27-0bd2420e3d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.915452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.916098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.916391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.916639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.918844 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:28.929366 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-8fc55b75-34b9-4ac6-9a27-0bd2420e3d9a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:28.931283 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8fc55b75-34b9-4ac6-9a27-0bd2420e3d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:28.941180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1208/2395] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:28.945458 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc55b75-34b9-4ac6-9a27-0bd2420e3d9a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.957172 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc55b75-34b9-4ac6-9a27-0bd2420e3d9a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:28.964538 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:28.965328 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:28.966617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:28.966947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:28.967684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:28.968495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.970947 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:28.984701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1209/2396] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:04:28.990225 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:28.996378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:28.998314 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:29.002723 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881e9a7-621f-4376-9731-8c0f247204fa admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:29.008714 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:29.009364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1188/2397] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:29.009839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:29.010266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:29.010866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:29.011655 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:29.014021 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:29.028595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:29.057558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1210/2398] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:28 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:29.059200 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:29.070626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735e741-a1d8-41f2-b4c4-50583212b1f9 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:29.181245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:29.183286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:29.183286 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:29.183608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:29.184317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:29.186579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:29.223788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1189/2399] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:29 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:29.229176 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:29.244667 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d59fa4-5caa-43e4-8de2-9945acf1b1fb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:29.257120 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:29.258776 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:29.259013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:29.259323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:29.260078 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:29.261810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:29.289716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1211/2400] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:29.291775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:29.306993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645bb5f-e727-419e-8621-b36de92bb8b6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:29.313767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39773959-0edc-4b66-97e8-d84af92aa8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:29.314848 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773959-0edc-4b66-97e8-d84af92aa8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:29.315233 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773959-0edc-4b66-97e8-d84af92aa8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:29.315684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39773959-0edc-4b66-97e8-d84af92aa8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:29.316486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39773959-0edc-4b66-97e8-d84af92aa8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:29.318268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39773959-0edc-4b66-97e8-d84af92aa8d4 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:29.332054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1190/2401] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:29.336467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:29.348108 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a4337-9713-4ad8-9654-089b0e842ef6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:29.355951 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:29.357000 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:29.357299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:29.357670 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] PATH_INFO: `/v3/projects/1f4e903c6a8f475ebee379b8afe4a547/users/289d353b7d1742acb4f4df1a5753211a/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:29.395539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f4e903c6a8f475ebee379b8afe4a547, user_id=289d353b7d1742acb4f4df1a5753211a, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:29.400027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:29.423031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1212/2402] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:29 2022] PUT /identity/v3/projects/1f4e903c6a8f475ebee379b8afe4a547/users/289d353b7d1742acb4f4df1a5753211a/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:29.438304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:29.439951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:29.440470 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:29.494820 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] MFA Rules not processed for user `289d353b7d1742acb4f4df1a5753211a`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:29.496585 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:29.603095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:29.619036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1191/2403] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:29.632420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:29.634352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:29.733354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714eca7d-40c5-4e2e-bb28-e9cb78b49ec8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:29.737816 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:29.738463 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:29.738742 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:29.739110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:29.748827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:29.750710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:29.764297 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1213/2404] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:30.197513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:30.206898 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:30.278037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7efb2-5241-433f-a11f-068a3351e1a8 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:30.283106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:30.283851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:30.284146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:30.284414 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] PATH_INFO: `/v3/users/463a0804f17940e4816ab7d984e52a74` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:30.285566 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=463a0804f17940e4816ab7d984e52a74)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:30.287524 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:30.336709 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463a0804f17940e4816ab7d984e52a74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.348699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463a0804f17940e4816ab7d984e52a74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.349438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463a0804f17940e4816ab7d984e52a74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.356521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463a0804f17940e4816ab7d984e52a74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.357155 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463a0804f17940e4816ab7d984e52a74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.374226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1192/2405] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:30 2022] DELETE /identity/v3/users/463a0804f17940e4816ab7d984e52a74 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:30.576048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:30.595919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b983e-bebd-4e28-8ae8-64abd1ea96f6 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:30.668810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:30.669481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:30.669789 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:30.670110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] PATH_INFO: `/v3/projects/7f07a2ab12d349b6a5b422f1c9264889` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:30.671245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f07a2ab12d349b6a5b422f1c9264889)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:30.673332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:30.732651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f07a2ab12d349b6a5b422f1c9264889', 'request_id': 'req-8394944e-42aa-460c-a0af-df890a98bb6f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.740236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f07a2ab12d349b6a5b422f1c9264889', 'request_id': 'req-8394944e-42aa-460c-a0af-df890a98bb6f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.741915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:30.743329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:30.744787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:30.747600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f07a2ab12d349b6a5b422f1c9264889', 'request_id': 'req-8394944e-42aa-460c-a0af-df890a98bb6f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.761982 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] The token cache is being invalidate because project 7f07a2ab12d349b6a5b422f1c9264889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:30.762269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.762876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8394944e-42aa-460c-a0af-df890a98bb6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:30.764430 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1214/2406] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:30 2022] DELETE /identity/v3/projects/7f07a2ab12d349b6a5b422f1c9264889 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:30.769502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48b31f-73f7-4f23-8edb-ced8c1a8e8f7 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:30.769788 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48b31f-73f7-4f23-8edb-ced8c1a8e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:30.770105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48b31f-73f7-4f23-8edb-ced8c1a8e8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:30.790231 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-be48b31f-73f7-4f23-8edb-ced8c1a8e8f7 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:30.792028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-be48b31f-73f7-4f23-8edb-ced8c1a8e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:30.812884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35609dd-f290-407b-9067-9de219acff6d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:30.847883 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:30.863216 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1215/2407] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:30.871004 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87aed-862a-4d01-956b-59dcfa5750b8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:30.871237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:30.871388 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87aed-862a-4d01-956b-59dcfa5750b8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:30.871549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c87aed-862a-4d01-956b-59dcfa5750b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:30.871707 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:30.871979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:30.872243 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:30.874161 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:30.891432 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-31c87aed-862a-4d01-956b-59dcfa5750b8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:30.892671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-31c87aed-862a-4d01-956b-59dcfa5750b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:30.901611 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1216/2408] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:30.905455 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87aed-862a-4d01-956b-59dcfa5750b8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:30.915309 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c87aed-862a-4d01-956b-59dcfa5750b8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:30.920160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:30.920744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:30.921339 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:30.921648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:30.922492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:30.922798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:30.924410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:30.933132 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:30.934611 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:30.936229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1217/2409] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:04:30.940699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:30.944495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1193/2410] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:30.950564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b8a44-998e-4e49-97d0-b888388b33e9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:30.955270 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:30.955905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:30.956210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:30.956451 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:30.957230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:30.959243 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:30.988111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1218/2411] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:30 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:30.992306 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:31.003405 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06ca47-9b5e-4b31-8b18-904075d30648 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:31.065635 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:31.066444 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:31.066726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:31.067005 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:31.067747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:31.069775 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:31.093621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1194/2412] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:30 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:31.098254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:31.109896 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446ea00-907d-4684-9ba5-fdce5244e21e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:31.114968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:31.115572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:31.115848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:31.116121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:31.116760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:31.118405 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:31.128566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1219/2413] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:31.132839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:31.143124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c12cd3-f4c0-40b9-9460-0cc3b2900796 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:31.148071 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff473e6b-f559-47ef-9059-9de7c2e9eb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:31.148745 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473e6b-f559-47ef-9059-9de7c2e9eb4c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:31.149024 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473e6b-f559-47ef-9059-9de7c2e9eb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:31.149289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff473e6b-f559-47ef-9059-9de7c2e9eb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:31.149954 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473e6b-f559-47ef-9059-9de7c2e9eb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:31.151552 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff473e6b-f559-47ef-9059-9de7c2e9eb4c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:31.161964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1195/2414] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:31.166241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:31.181160 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1258c05-2235-4f91-ae6c-2518218894f6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:31.186218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:31.186929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:31.187228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:31.187511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] PATH_INFO: `/v3/projects/4b47c34659c84861882a8f84c4cbff90/users/4dc115d3bc3246ae8ab64d04ed974dcf/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:31.205151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b47c34659c84861882a8f84c4cbff90, user_id=4dc115d3bc3246ae8ab64d04ed974dcf, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:31.207873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:31.222889 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1220/2415] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:31 2022] PUT /identity/v3/projects/4b47c34659c84861882a8f84c4cbff90/users/4dc115d3bc3246ae8ab64d04ed974dcf/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:31.233617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:31.234111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:31.234206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:31.263671 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] MFA Rules not processed for user `4dc115d3bc3246ae8ab64d04ed974dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:31.264900 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:31.333158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:31.350072 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1196/2416] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:31.363902 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:31.367754 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:31.487449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcc222-5b6a-4e69-8cf4-72b6a92f9356 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:31.493409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:31.494140 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:31.494501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:31.494832 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:31.501820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:31.505013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:31.507269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:31.518364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1221/2417] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:31.550882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:31.552343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:31.621587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7eeadc-7245-481f-a774-f4a5ca5706bb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:31.626343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4a614-0035-4245-b13d-688309168b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:31.626970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4a614-0035-4245-b13d-688309168b8d service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:31.627261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4a614-0035-4245-b13d-688309168b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:31.627533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4a614-0035-4245-b13d-688309168b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:31.629607 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-06a4a614-0035-4245-b13d-688309168b8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:31.709910 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4a614-0035-4245-b13d-688309168b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:31.711374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4a614-0035-4245-b13d-688309168b8d service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:31.728407 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1197/2418] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:34.385464 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:34.450673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107058a-af51-46ce-a070-2b3e7bb267a4 service nova] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:34.455401 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:34.456118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:34.456376 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:34.456600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] PATH_INFO: `/v3/users/4dc115d3bc3246ae8ab64d04ed974dcf` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:34.457809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc115d3bc3246ae8ab64d04ed974dcf)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:34.460086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:34.531073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc115d3bc3246ae8ab64d04ed974dcf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:34.531798 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc115d3bc3246ae8ab64d04ed974dcf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:34.532516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc115d3bc3246ae8ab64d04ed974dcf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:34.545546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc115d3bc3246ae8ab64d04ed974dcf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:34.552556 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc115d3bc3246ae8ab64d04ed974dcf'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:34.567409 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1222/2419] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:34 2022] DELETE /identity/v3/users/4dc115d3bc3246ae8ab64d04ed974dcf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:34.572608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:34.573112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:34.573234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:34.595838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:34.597096 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:34.662451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1198/2420] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:34.673410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:34.675083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:34.738383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa50c74-8be2-4e2d-83ea-7d4bed99d3ef admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:34.742425 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c216060-7e4f-40c0-8e48-34ef22c1413b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:34.743051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c216060-7e4f-40c0-8e48-34ef22c1413b service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:34.743336 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c216060-7e4f-40c0-8e48-34ef22c1413b service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:34.743625 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c216060-7e4f-40c0-8e48-34ef22c1413b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:34.752795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c216060-7e4f-40c0-8e48-34ef22c1413b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:34.754313 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c216060-7e4f-40c0-8e48-34ef22c1413b service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:34.764989 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1223/2421] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:35.043360 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.044932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.057855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea6788-8047-4a87-8d01-df4fca7444c2 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.063362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.064039 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.064406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.064728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] PATH_INFO: `/v3/projects/4b47c34659c84861882a8f84c4cbff90` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.066014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b47c34659c84861882a8f84c4cbff90)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.067968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.110404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:35.119023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b47c34659c84861882a8f84c4cbff90', 'request_id': 'req-200d3ca4-5540-46ef-8247-f3c91461e4c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.125837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b47c34659c84861882a8f84c4cbff90', 'request_id': 'req-200d3ca4-5540-46ef-8247-f3c91461e4c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.131532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b47c34659c84861882a8f84c4cbff90', 'request_id': 'req-200d3ca4-5540-46ef-8247-f3c91461e4c2'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.146077 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] The token cache is being invalidate because project 4b47c34659c84861882a8f84c4cbff90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:35.146369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.146987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-200d3ca4-5540-46ef-8247-f3c91461e4c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.148481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1199/2422] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:35 2022] DELETE /identity/v3/projects/4b47c34659c84861882a8f84c4cbff90 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:35.153571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943054-0722-4042-a324-3bd3cd000ca8 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.153986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943054-0722-4042-a324-3bd3cd000ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.154320 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943054-0722-4042-a324-3bd3cd000ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.176234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c2943054-0722-4042-a324-3bd3cd000ca8 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:35.177484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c2943054-0722-4042-a324-3bd3cd000ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.191460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:35.248370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1224/2423] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:35.258057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415c21-b113-4581-829d-bced4be66951 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.258339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415c21-b113-4581-829d-bced4be66951 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.258616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415c21-b113-4581-829d-bced4be66951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.279119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1d415c21-b113-4581-829d-bced4be66951 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:35.280395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1d415c21-b113-4581-829d-bced4be66951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.288645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1200/2424] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:35.293539 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943054-0722-4042-a324-3bd3cd000ca8 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.304466 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943054-0722-4042-a324-3bd3cd000ca8 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.309612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.310265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.310543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.310814 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.311658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:35.312019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.313873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.327279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1225/2425] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:35.332078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d415c21-b113-4581-829d-bced4be66951 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.342165 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d415c21-b113-4581-829d-bced4be66951 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.347188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.347812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.348097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.348364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.349041 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.350989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.383899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1201/2426] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:35.389325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.391433 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.391749 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.405228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cfc40-a069-41b3-9420-1ab6e1c488dc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.456825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b3180-17fc-4eea-a1c6-0a6c92ddf374 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.461650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.462245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.462536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.462789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.463439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.464679 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.465322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.465464 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.465633 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.465905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] PATH_INFO: `/v3/users/289d353b7d1742acb4f4df1a5753211a` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.467676 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289d353b7d1742acb4f4df1a5753211a)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.470129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.487919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1202/2427] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:35.492023 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.502734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a924d11-6b05-4c71-93a4-b7727324f120 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.507859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.508586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.508961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.509333 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.510004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.511924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.522867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1203/2428] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:35.527595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.527876 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289d353b7d1742acb4f4df1a5753211a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.528659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289d353b7d1742acb4f4df1a5753211a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.529298 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289d353b7d1742acb4f4df1a5753211a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.538168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f694c-5503-401c-9f44-28b4d670657d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.542875 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289d353b7d1742acb4f4df1a5753211a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.543644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.544324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.544609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.544884 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.545606 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.547326 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.550602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-3c64d293-db4f-4ef7-b127-66edee115ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289d353b7d1742acb4f4df1a5753211a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.562806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1204/2429] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:35.564068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.565591 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1226/2430] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:35 2022] DELETE /identity/v3/users/289d353b7d1742acb4f4df1a5753211a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:35.566128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.569701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.570002 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.570352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.579349 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33d354-c0ce-4270-8371-3b6717231519 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.590238 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:35.591618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.612821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:35.641498 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f4c83-3fba-4c7d-9bc0-eca081fe2251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.642193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4c83-3fba-4c7d-9bc0-eca081fe2251 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.642795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4c83-3fba-4c7d-9bc0-eca081fe2251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.643073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f4c83-3fba-4c7d-9bc0-eca081fe2251 admin admin] PATH_INFO: `/v3/projects/07aeb895a2224189a1c1339a23e39650/users/ca642ac26c4b4b23a8d283960597d29d/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.658150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:35.665205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1227/2431] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:35.665445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f4c83-3fba-4c7d-9bc0-eca081fe2251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07aeb895a2224189a1c1339a23e39650, user_id=ca642ac26c4b4b23a8d283960597d29d, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.665445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f4c83-3fba-4c7d-9bc0-eca081fe2251 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.673354 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.675335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.691248 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1205/2432] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:35 2022] PUT /identity/v3/projects/07aeb895a2224189a1c1339a23e39650/users/ca642ac26c4b4b23a8d283960597d29d/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:35.698318 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.698620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.698891 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.737768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] MFA Rules not processed for user `ca642ac26c4b4b23a8d283960597d29d`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:35.739158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.750848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40980c-6ae2-438e-bb50-93ad384b47df None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.808822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.809355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.809677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.809942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.814846 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1206/2433] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:35.816325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.817807 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:35.885645 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.887189 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.896370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ed0a2-5afb-4e08-97b6-cd57481c71ca None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.898972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1228/2434] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:35.900357 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.901626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.902261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.902540 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.902812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] PATH_INFO: `/v3/users/619969a0a4df4c54ab4c05bf8c48b60e` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.903965 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=619969a0a4df4c54ab4c05bf8c48b60e)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.905972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.916516 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2bd13f-0bce-45bd-9de9-2dce2d536f39 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:35.924059 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:35.925092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:35.925598 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:35.926113 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:35.927223 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:35.930974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:35.963085 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '619969a0a4df4c54ab4c05bf8c48b60e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.980323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1229/2435] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/projects => generated 355 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:35.982129 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:35.983579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '619969a0a4df4c54ab4c05bf8c48b60e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.984300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '619969a0a4df4c54ab4c05bf8c48b60e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.995043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '619969a0a4df4c54ab4c05bf8c48b60e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.995809 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9fe32e60-4cc4-4301-b2c7-7eb641136b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '619969a0a4df4c54ab4c05bf8c48b60e'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:35.999834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.006806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.015075 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1207/2436] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:35 2022] DELETE /identity/v3/users/619969a0a4df4c54ab4c05bf8c48b60e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:36.020507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.020976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.021186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.042350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:36.043666 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.075086 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a683a48-0a05-4850-b77e-0cf0b075857b admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.118124 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1208/2437] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:36.128945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.130760 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.145456 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.146639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.146639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.146900 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.147396 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.149503 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.174673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1230/2438] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:35 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:36.181395 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.183492 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.196618 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e648e4b-7df8-4224-b104-b93e056b989f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.201588 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.202233 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.202517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.202787 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.203450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.205074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.207871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94bd6c0-b16b-4770-92fb-1bb022930c9f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.213581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.214251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.214604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.214897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.219920 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1231/2439] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:36.221299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.227491 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.228942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.235459 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc468e-2947-486a-9151-f0e26bd9b33c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.241276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.241990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.242266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.242538 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] PATH_INFO: `/v3/projects/9e5fbfcc3b724cda9e3f50535045dcf6/users/92d6a0ae3a4a4e2c87202c560b319d6c/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.243038 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1209/2440] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:36.243876 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.245310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.261117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5fbfcc3b724cda9e3f50535045dcf6, user_id=92d6a0ae3a4a4e2c87202c560b319d6c, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.264985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.274436 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bfdcf-2b9e-420d-b7d8-a6ca8437ca88 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.279901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.280679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.281043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.281316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] PATH_INFO: `/v3/projects/1f4e903c6a8f475ebee379b8afe4a547` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.282495 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f4e903c6a8f475ebee379b8afe4a547)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.284482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.285687 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1232/2441] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:36 2022] PUT /identity/v3/projects/9e5fbfcc3b724cda9e3f50535045dcf6/users/92d6a0ae3a4a4e2c87202c560b319d6c/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:36.290027 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.349006 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f4e903c6a8f475ebee379b8afe4a547', 'request_id': 'req-4ac31090-09cb-4d8c-b4bd-11b71dde2862'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.355507 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f4e903c6a8f475ebee379b8afe4a547', 'request_id': 'req-4ac31090-09cb-4d8c-b4bd-11b71dde2862'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.362550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f4e903c6a8f475ebee379b8afe4a547', 'request_id': 'req-4ac31090-09cb-4d8c-b4bd-11b71dde2862'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.369192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d81f1f-bcf5-498c-8163-6bfd47aa681f admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.376747 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] The token cache is being invalidate because project 1f4e903c6a8f475ebee379b8afe4a547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:36.377321 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.378154 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4ac31090-09cb-4d8c-b4bd-11b71dde2862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.379993 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1210/2442] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:36 2022] DELETE /identity/v3/projects/1f4e903c6a8f475ebee379b8afe4a547 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:36.385590 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae43f1-eb2a-4888-a723-e0daef3a9737 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.385982 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae43f1-eb2a-4888-a723-e0daef3a9737 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.386284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae43f1-eb2a-4888-a723-e0daef3a9737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.392673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.413432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0cae43f1-eb2a-4888-a723-e0daef3a9737 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:36.414776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0cae43f1-eb2a-4888-a723-e0daef3a9737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.442826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.473362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.474191 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.474467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.474884 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.475616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.477870 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.493431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1233/2443] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:36.497290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.499106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.511850 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1211/2444] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:36.513438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67aaf0a-9f78-4742-a7e3-1a625bf803eb admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.518168 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524f83e-7603-437e-952c-cf00dc78f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.518852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f83e-7603-437e-952c-cf00dc78f57f admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.519115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f83e-7603-437e-952c-cf00dc78f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.519384 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524f83e-7603-437e-952c-cf00dc78f57f admin admin] PATH_INFO: `/v3/projects/9e5fbfcc3b724cda9e3f50535045dcf6/users/92d6a0ae3a4a4e2c87202c560b319d6c/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.519612 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.519905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.520172 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.521455 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524f83e-7603-437e-952c-cf00dc78f57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5fbfcc3b724cda9e3f50535045dcf6, user_id=92d6a0ae3a4a4e2c87202c560b319d6c, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.526317 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524f83e-7603-437e-952c-cf00dc78f57f admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.541054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1234/2445] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:36 2022] PUT /identity/v3/projects/9e5fbfcc3b724cda9e3f50535045dcf6/users/92d6a0ae3a4a4e2c87202c560b319d6c/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:36.542009 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:36.543237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.551359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a95ea-be91-46fb-8fce-280213997987 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.551722 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a95ea-be91-46fb-8fce-280213997987 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.551914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a95ea-be91-46fb-8fce-280213997987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.587809 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-2a8a95ea-be91-46fb-8fce-280213997987 None None] MFA Rules not processed for user `92d6a0ae3a4a4e2c87202c560b319d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:36.589240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-2a8a95ea-be91-46fb-8fce-280213997987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.626443 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1212/2446] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:36.630150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.630150 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.640676 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3fa56-4154-48fd-92e3-c22d5228078a None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.645328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.645979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.646256 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.646528 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] PATH_INFO: `/v3/projects/535b81e13f5a46c5917758a93a93af84` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.647658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] RBAC: Authorizing `identity:delete_project(project_id=535b81e13f5a46c5917758a93a93af84)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.649582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.663634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1235/2447] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:36.664899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a95ea-be91-46fb-8fce-280213997987 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.677688 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a95ea-be91-46fb-8fce-280213997987 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.682639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.683334 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.683682 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.683975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.684677 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:36.685014 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.686934 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.699447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1236/2448] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:36.700278 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.702018 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.706990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535b81e13f5a46c5917758a93a93af84', 'request_id': 'req-0dffecfd-6198-4c5a-acd5-8c4c4630142d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.714363 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535b81e13f5a46c5917758a93a93af84', 'request_id': 'req-0dffecfd-6198-4c5a-acd5-8c4c4630142d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.722889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535b81e13f5a46c5917758a93a93af84', 'request_id': 'req-0dffecfd-6198-4c5a-acd5-8c4c4630142d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.737686 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] The token cache is being invalidate because project 535b81e13f5a46c5917758a93a93af84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:36.737966 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.738839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:36.740511 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1213/2449] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:36 2022] DELETE /identity/v3/projects/535b81e13f5a46c5917758a93a93af84 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:36.743645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.743645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.762041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f6d1f-7fe0-471d-96f2-d48b5bc407c6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.789123 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.796072 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:36.814011 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffecfd-6198-4c5a-acd5-8c4c4630142d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.814526 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.815386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.815856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.816224 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.818142 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.819410 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.820022 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.820294 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.820560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.821187 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.823221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.861967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1214/2450] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:36 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:36.861967 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.863829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:36.884658 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.886217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.896370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1237/2451] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:36.897179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:36.909844 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d5523-cbc2-4356-807c-574de4123079 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.931926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058c893-83c9-444a-8f0b-1ff5d35ab7c9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:36.937788 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.938514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.938732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.938998 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] PATH_INFO: `/v3/users/faddc6e074944829ad2ddbd52c9d75fe` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.940126 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faddc6e074944829ad2ddbd52c9d75fe)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.942110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:36.984715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:36.985449 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:36.985827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:36.986106 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:36.987092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:36.989097 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.003001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faddc6e074944829ad2ddbd52c9d75fe'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.018446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1238/2452] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:36 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:37.018446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:37.018446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:37.021658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faddc6e074944829ad2ddbd52c9d75fe'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.022380 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faddc6e074944829ad2ddbd52c9d75fe'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.030459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faddc6e074944829ad2ddbd52c9d75fe'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.031313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faddc6e074944829ad2ddbd52c9d75fe'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.046625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1215/2453] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:36 2022] DELETE /identity/v3/users/faddc6e074944829ad2ddbd52c9d75fe => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:37.047487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:37.051324 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:37.089894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55902b5-85da-48a3-8c0e-e935eede10e6 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:37.116945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:37.121753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:37.149614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73318166-4dd5-482d-bda0-3d31a758cc74 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:37.156020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:37.156179 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7233813-5599-456f-9966-275ed0d9a11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:37.156608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.156719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7233813-5599-456f-9966-275ed0d9a11e service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.157206 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7233813-5599-456f-9966-275ed0d9a11e service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.157315 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.157659 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7233813-5599-456f-9966-275ed0d9a11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.157793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.158370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:37.159749 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a7233813-5599-456f-9966-275ed0d9a11e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:37.160322 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.172091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1216/2454] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:37.176660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:37.187424 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df554b7-2006-43a3-8c89-0bb2dfc75231 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:37.192201 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:37.192814 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.193095 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.193373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.194050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:37.195695 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.209697 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1217/2455] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:04:37.211762 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:37.225582 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94ff50-9a5f-4b7f-9e4b-6d4458e7c9d9 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:37.231644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:37.232338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.232617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.232888 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] PATH_INFO: `/v3/projects/9fc86cb4a7534998988c372fe48ece0e/users/b903aa5d5b7341ada6609567a12f913f/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.238617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7233813-5599-456f-9966-275ed0d9a11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:37.240438 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7233813-5599-456f-9966-275ed0d9a11e service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.250720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1239/2456] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:37.252186 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc86cb4a7534998988c372fe48ece0e, user_id=b903aa5d5b7341ada6609567a12f913f, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:37.254961 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.273426 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1218/2457] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:37 2022] PUT /identity/v3/projects/9fc86cb4a7534998988c372fe48ece0e/users/b903aa5d5b7341ada6609567a12f913f/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:37.283368 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.283651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.283928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.319846 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] MFA Rules not processed for user `b903aa5d5b7341ada6609567a12f913f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:37.321125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:37.376604 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:37.378696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:37.421340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1240/2458] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:37.439023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:37.440495 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:37.465239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eea040-5024-4eea-b7f9-09f41cf7043b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:37.471089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:37.471924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.472239 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.472530 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] PATH_INFO: `/v3/projects/0f384cea364d42d1b604a99a8ab44eab` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.473687 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f384cea364d42d1b604a99a8ab44eab)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:37.475623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.503474 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb540cf-7e6e-47ce-b5e4-d9540db0106e None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:37.507467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:37.508083 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.508965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.509247 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.518361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:37.519834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.523302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f384cea364d42d1b604a99a8ab44eab', 'request_id': 'req-8f105079-4959-4045-93f8-618ad7773acb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.529450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1241/2459] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:37.530481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f384cea364d42d1b604a99a8ab44eab', 'request_id': 'req-8f105079-4959-4045-93f8-618ad7773acb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.543761 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f384cea364d42d1b604a99a8ab44eab', 'request_id': 'req-8f105079-4959-4045-93f8-618ad7773acb'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.556877 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] The token cache is being invalidate because project 0f384cea364d42d1b604a99a8ab44eab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:37.557193 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.557968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.559817 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1219/2460] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:37 2022] DELETE /identity/v3/projects/0f384cea364d42d1b604a99a8ab44eab => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:37.564124 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:37.575939 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b48ef-dc15-4042-af35-260ba8b9c1c9 service cinder] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:37.584411 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:37.643434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:37.644063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:37.644325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:37.644708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] PATH_INFO: `/v3/users/a06ab9953e344cf1a38632048d47ee6e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:37.646015 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a06ab9953e344cf1a38632048d47ee6e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:37.648143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:37.702347 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a06ab9953e344cf1a38632048d47ee6e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.704562 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a06ab9953e344cf1a38632048d47ee6e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.705834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a06ab9953e344cf1a38632048d47ee6e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.730879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a06ab9953e344cf1a38632048d47ee6e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.744241 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-6d0ca435-b992-421a-9bee-0200876b6e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a06ab9953e344cf1a38632048d47ee6e'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:37.767437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1242/2461] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:37 2022] DELETE /identity/v3/users/a06ab9953e344cf1a38632048d47ee6e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:38.077017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:38.078916 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:38.095317 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f105079-4959-4045-93f8-618ad7773acb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:38.151499 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:38.170013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:38.170722 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:38.171032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:38.171432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] PATH_INFO: `/v3/projects/4e0825c637bc4677a13092453d7fb77f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:38.172677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0825c637bc4677a13092453d7fb77f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:38.174700 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:38.227536 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0825c637bc4677a13092453d7fb77f', 'request_id': 'req-64556b44-6164-4aee-bcea-4191597336a8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:38.236640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0825c637bc4677a13092453d7fb77f', 'request_id': 'req-64556b44-6164-4aee-bcea-4191597336a8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:38.244466 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0825c637bc4677a13092453d7fb77f', 'request_id': 'req-64556b44-6164-4aee-bcea-4191597336a8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:38.259661 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] The token cache is being invalidate because project 4e0825c637bc4677a13092453d7fb77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:38.260068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:38.260825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:38.262390 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1220/2462] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:38 2022] DELETE /identity/v3/projects/4e0825c637bc4677a13092453d7fb77f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:38.965871 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443e81-3e05-47c1-b91e-f668aa044ec6 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:38.966472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443e81-3e05-47c1-b91e-f668aa044ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:38.966596 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443e81-3e05-47c1-b91e-f668aa044ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:38.989753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-47443e81-3e05-47c1-b91e-f668aa044ec6 None None] MFA Rules not processed for user `b903aa5d5b7341ada6609567a12f913f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:38.990963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-47443e81-3e05-47c1-b91e-f668aa044ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:39.055532 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1243/2463] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:48.255997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:49.047929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=73,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:52.668699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:52.670265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:52.742381 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64556b44-6164-4aee-bcea-4191597336a8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:52.747980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:52.748656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:52.748976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:52.749268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] PATH_INFO: `/v3/users/ca642ac26c4b4b23a8d283960597d29d` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:52.750530 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca642ac26c4b4b23a8d283960597d29d)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:52.752502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:52.806060 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca642ac26c4b4b23a8d283960597d29d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:52.821240 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca642ac26c4b4b23a8d283960597d29d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:52.822206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca642ac26c4b4b23a8d283960597d29d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:52.830523 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca642ac26c4b4b23a8d283960597d29d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:52.831313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca642ac26c4b4b23a8d283960597d29d'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:52.848056 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1221/2464] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:52 2022] DELETE /identity/v3/users/ca642ac26c4b4b23a8d283960597d29d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:52.853622 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c9797-7d77-49d0-a80b-193125d2ee06 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:52.854350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c9797-7d77-49d0-a80b-193125d2ee06 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:52.854350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c9797-7d77-49d0-a80b-193125d2ee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:52.875267 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-df9c9797-7d77-49d0-a80b-193125d2ee06 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:52.876502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-df9c9797-7d77-49d0-a80b-193125d2ee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:52.937072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1244/2465] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:52.947316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:52.948842 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:53.010175 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a0a22-5129-474f-8493-5b66f071618d admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:53.013964 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:53.014645 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:53.014969 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:53.015270 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:53.025136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:53.026634 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:53.037454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1222/2466] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:53.210783 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:53.211044 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:53.211426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:53.244308 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:53.245911 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:53.307997 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1245/2467] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:04:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:53.364032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:53.365568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:53.387626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:53.389355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:53.405450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:53.409894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d190ec1-502e-4d5b-b531-3c32411678dd None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:53.415032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:53.415732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:53.415975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:53.416248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] PATH_INFO: `/v3/projects/07aeb895a2224189a1c1339a23e39650` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:53.417651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=07aeb895a2224189a1c1339a23e39650)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:53.419636 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:53.475617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274afa8-0986-49f9-80b0-6f4501feba49 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:53.480926 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07aeb895a2224189a1c1339a23e39650', 'request_id': 'req-8401afa2-b413-4557-9967-576766c597dc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.488557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07aeb895a2224189a1c1339a23e39650', 'request_id': 'req-8401afa2-b413-4557-9967-576766c597dc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.495170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07aeb895a2224189a1c1339a23e39650', 'request_id': 'req-8401afa2-b413-4557-9967-576766c597dc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.510727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] The token cache is being invalidate because project 07aeb895a2224189a1c1339a23e39650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:53.511013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.511673 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.513807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1246/2468] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:53 2022] DELETE /identity/v3/projects/07aeb895a2224189a1c1339a23e39650 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:04:53.518470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:53.520112 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:53.557640 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:53.558111 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:53.558432 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:53.558743 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:53.559344 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:53.561319 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:53.599836 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8401afa2-b413-4557-9967-576766c597dc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:53.606489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:53.607159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:53.607452 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:53.607717 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] PATH_INFO: `/v3/users/92d6a0ae3a4a4e2c87202c560b319d6c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:53.609193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d6a0ae3a4a4e2c87202c560b319d6c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:53.611649 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:53.638514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:53.640296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:53.650212 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1223/2469] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:04:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:04:53.681005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d6a0ae3a4a4e2c87202c560b319d6c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.681748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d6a0ae3a4a4e2c87202c560b319d6c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.682365 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d6a0ae3a4a4e2c87202c560b319d6c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.699338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d6a0ae3a4a4e2c87202c560b319d6c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.709345 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-2ca7cce9-c239-411b-8035-1f3821c571c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d6a0ae3a4a4e2c87202c560b319d6c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:53.729184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1247/2470] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:53 2022] DELETE /identity/v3/users/92d6a0ae3a4a4e2c87202c560b319d6c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:54.129291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.142506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796215d5-c6ef-46f6-941e-9f36bb4f84c8 service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.234157 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.234906 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.235629 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.236084 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] PATH_INFO: `/v3/projects/9e5fbfcc3b724cda9e3f50535045dcf6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.237460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5fbfcc3b724cda9e3f50535045dcf6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.239728 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.248795 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:54.298181 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5fbfcc3b724cda9e3f50535045dcf6', 'request_id': 'req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:54.306097 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5fbfcc3b724cda9e3f50535045dcf6', 'request_id': 'req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:54.314345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5fbfcc3b724cda9e3f50535045dcf6', 'request_id': 'req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:54.330715 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] The token cache is being invalidate because project 9e5fbfcc3b724cda9e3f50535045dcf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:54.331052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:54.331636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-e79bfdf3-e8b5-453d-8400-a8fd4c552fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:54.333166 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1224/2471] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:54 2022] DELETE /identity/v3/projects/9e5fbfcc3b724cda9e3f50535045dcf6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:54.339311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afea-f866-4ee4-a3e1-02be261b6cb3 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.339827 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afea-f866-4ee4-a3e1-02be261b6cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.339945 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.340107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858afea-f866-4ee4-a3e1-02be261b6cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.340293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.340451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.361976 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:54.362268 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-3858afea-f866-4ee4-a3e1-02be261b6cb3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:54.363214 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:54.363555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-3858afea-f866-4ee4-a3e1-02be261b6cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:54.433482 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1248/2472] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:54.435704 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1225/2473] 10.222.0.52 () {58 vars in 967 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:54.441791 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9198971-cbf9-4620-8cb7-3b5e42324dbb None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.442041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9198971-cbf9-4620-8cb7-3b5e42324dbb None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.442307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9198971-cbf9-4620-8cb7-3b5e42324dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.455211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.456826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:54.472778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-c9198971-cbf9-4620-8cb7-3b5e42324dbb None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:54.474037 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-c9198971-cbf9-4620-8cb7-3b5e42324dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:54.482944 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1249/2474] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:54.487716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9198971-cbf9-4620-8cb7-3b5e42324dbb None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.498048 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9198971-cbf9-4620-8cb7-3b5e42324dbb None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.507210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.508794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.508794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.508794 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.509217 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:54.509312 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.511032 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.528228 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1250/2475] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 28 20:04:54.529807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.540089 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446b5dd-a20b-4c52-ab80-a25737d4da23 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.540726 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53532d4d-9047-4e47-ab29-dda462bb33a0 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.545443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.546107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.546265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.546383 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.546660 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.546776 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.546977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.547247 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.547361 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.549341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.556903 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.558526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.567500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1226/2476] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:04:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:04:54.583012 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1251/2477] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:54.587683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.601639 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a97b5a-48c4-467e-a7a5-a8494fb9f545 service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.642054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:54.681259 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.682652 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.682940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.683216 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.683889 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.685920 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.709421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1227/2478] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:04:54.713919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.726139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba862-ff02-440b-860e-7ab1dfa81508 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.731628 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.732240 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.732518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.732786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.733607 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.735153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.737127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:54.753370 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1252/2479] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:54.754828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.767628 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee8266-a45d-4bf9-b20b-60423f687aa2 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.775110 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc2da7-e4af-4059-95e7-7ea80fcf3875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.776112 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2da7-e4af-4059-95e7-7ea80fcf3875 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.776600 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2da7-e4af-4059-95e7-7ea80fcf3875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.777089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc2da7-e4af-4059-95e7-7ea80fcf3875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.779092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2da7-e4af-4059-95e7-7ea80fcf3875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.781440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc2da7-e4af-4059-95e7-7ea80fcf3875 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.798289 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1228/2480] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:54.804074 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.815662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa5c91-f4b4-44b3-b3b0-9e409d065bb8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:54.821721 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c630b-76d8-4c2e-94e6-c0af55cba341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:54.822399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c630b-76d8-4c2e-94e6-c0af55cba341 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.822683 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c630b-76d8-4c2e-94e6-c0af55cba341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.822991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c630b-76d8-4c2e-94e6-c0af55cba341 admin admin] PATH_INFO: `/v3/projects/44b012a1d3e2423ba90d7f7860f4b910/users/60083226788d4b65ae091ce49a95b671/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.834784 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95611-a57e-4eb8-8dea-2f2fb4c8d9c7 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.835078 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95611-a57e-4eb8-8dea-2f2fb4c8d9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.835354 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95611-a57e-4eb8-8dea-2f2fb4c8d9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.845343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c630b-76d8-4c2e-94e6-c0af55cba341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b012a1d3e2423ba90d7f7860f4b910, user_id=60083226788d4b65ae091ce49a95b671, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:54.848105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c630b-76d8-4c2e-94e6-c0af55cba341 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:54.858438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e5a95611-a57e-4eb8-8dea-2f2fb4c8d9c7 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:54.859373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e5a95611-a57e-4eb8-8dea-2f2fb4c8d9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:54.864545 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1253/2481] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:54 2022] PUT /identity/v3/projects/44b012a1d3e2423ba90d7f7860f4b910/users/60083226788d4b65ae091ce49a95b671/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:54.875138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d3417-44a4-4b05-80a2-9a10f2ac4206 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:54.875436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d3417-44a4-4b05-80a2-9a10f2ac4206 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:54.875691 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d3417-44a4-4b05-80a2-9a10f2ac4206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:54.906641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-480d3417-44a4-4b05-80a2-9a10f2ac4206 None None] MFA Rules not processed for user `60083226788d4b65ae091ce49a95b671`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:54.908022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-480d3417-44a4-4b05-80a2-9a10f2ac4206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:54.921829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1229/2482] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:54.934092 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95611-a57e-4eb8-8dea-2f2fb4c8d9c7 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:54.990469 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1254/2483] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:54.995071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d3417-44a4-4b05-80a2-9a10f2ac4206 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.012168 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95611-a57e-4eb8-8dea-2f2fb4c8d9c7 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.018664 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.019291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.019570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.019841 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.029265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.030942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.039977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1230/2484] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:04:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:04:55.072125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d3417-44a4-4b05-80a2-9a10f2ac4206 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.079143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.080680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.080680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.080680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.081252 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.083128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.117472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1255/2485] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:54 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:55.121793 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.133482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe86d-9d04-4d7b-a6ec-1130ef24822c service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.186786 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:55.209275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.209924 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.210206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.210515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.211118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.213098 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.239089 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1231/2486] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:55 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:55.243427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.255110 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b3bdc-b0f7-4436-964b-55f127fb9e10 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.260988 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.261554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.262546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.262838 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.263813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.265744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.280786 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1256/2487] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:55.282014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.293537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba31270-fad2-4db4-9641-f66fa0acfd43 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.299626 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.300501 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.300770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.301180 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] PATH_INFO: `/v3/projects/5ce2f161aa094f9796d185742ecb1b13/users/ceab30f88b1c4fa1b6f558b56bf447af/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.319653 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce2f161aa094f9796d185742ecb1b13, user_id=ceab30f88b1c4fa1b6f558b56bf447af, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.325893 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.340796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1232/2488] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:55 2022] PUT /identity/v3/projects/5ce2f161aa094f9796d185742ecb1b13/users/ceab30f88b1c4fa1b6f558b56bf447af/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:55.345117 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.355528 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c36d8-ebfb-4e13-b480-3ed274744543 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.392557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:55.421793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b200388-8010-4433-a9d6-8ba1dd9c0811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.422427 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b200388-8010-4433-a9d6-8ba1dd9c0811 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.422699 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b200388-8010-4433-a9d6-8ba1dd9c0811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.422969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b200388-8010-4433-a9d6-8ba1dd9c0811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.423621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b200388-8010-4433-a9d6-8ba1dd9c0811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.425245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b200388-8010-4433-a9d6-8ba1dd9c0811 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.440310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1257/2489] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:55.441711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.458149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19630bc2-1662-46aa-aac3-30d1392c7538 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.464118 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbd68b-fde9-4693-add7-bbc3827a5f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.465070 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd68b-fde9-4693-add7-bbc3827a5f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.465419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd68b-fde9-4693-add7-bbc3827a5f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.465833 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbd68b-fde9-4693-add7-bbc3827a5f51 admin admin] PATH_INFO: `/v3/projects/5ce2f161aa094f9796d185742ecb1b13/users/ceab30f88b1c4fa1b6f558b56bf447af/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.467174 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b98c-eb37-4b05-97a3-29a8da1a7a06 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.467444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b98c-eb37-4b05-97a3-29a8da1a7a06 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.467768 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701b98c-eb37-4b05-97a3-29a8da1a7a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.468049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd68b-fde9-4693-add7-bbc3827a5f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ce2f161aa094f9796d185742ecb1b13, user_id=ceab30f88b1c4fa1b6f558b56bf447af, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.471169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbd68b-fde9-4693-add7-bbc3827a5f51 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.484650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1233/2490] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:55 2022] PUT /identity/v3/projects/5ce2f161aa094f9796d185742ecb1b13/users/ceab30f88b1c4fa1b6f558b56bf447af/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:55.490236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-9701b98c-eb37-4b05-97a3-29a8da1a7a06 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:55.491626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-9701b98c-eb37-4b05-97a3-29a8da1a7a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:55.498177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.498902 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.499433 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.535043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] MFA Rules not processed for user `ceab30f88b1c4fa1b6f558b56bf447af`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:55.536907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:55.554445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1258/2491] 10.222.0.52 () {58 vars in 967 bytes} [Fri Oct 28 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:04:55.571003 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b98c-eb37-4b05-97a3-29a8da1a7a06 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.628479 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1234/2492] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:55.640516 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:55.643605 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:55.647748 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701b98c-eb37-4b05-97a3-29a8da1a7a06 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.655277 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.655955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.656229 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.656502 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.667866 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.671007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.682088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1259/2493] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:04:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:04:55.713972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa67f95-c29c-446d-b951-c81efdfc3b1b None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:55.720571 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:55.721203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:55.721570 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:55.721899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:55.769068 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:55.798558 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:55.800149 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:55.811485 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1235/2494] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:04:57.230929 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:57.242016 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c901b-452b-412b-bb6e-948aeddc48b8 service swift] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:57.246448 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a9a60-9bba-495a-8732-a02532c8c8e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:57.247049 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9a60-9bba-495a-8732-a02532c8c8e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:57.247325 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9a60-9bba-495a-8732-a02532c8c8e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:57.247593 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9a60-9bba-495a-8732-a02532c8c8e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:57.258465 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a9a60-9bba-495a-8732-a02532c8c8e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:57.259919 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a9a60-9bba-495a-8732-a02532c8c8e1 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:57.270421 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1260/2495] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:57.902249 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:57.903892 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:57.972543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd428ed-832d-49e6-b61c-015437ef1345 service cinder] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:57.977756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:57.978465 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:57.978741 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:57.979012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] PATH_INFO: `/v3/users/b903aa5d5b7341ada6609567a12f913f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:57.980285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b903aa5d5b7341ada6609567a12f913f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:57.982292 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.039801 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b903aa5d5b7341ada6609567a12f913f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.059769 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b903aa5d5b7341ada6609567a12f913f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.060548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b903aa5d5b7341ada6609567a12f913f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.069486 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b903aa5d5b7341ada6609567a12f913f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.070369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b903aa5d5b7341ada6609567a12f913f'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.085932 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1236/2496] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:04:57 2022] DELETE /identity/v3/users/b903aa5d5b7341ada6609567a12f913f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:58.090719 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.090990 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.091336 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.112289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:58.113882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.163922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:58.182005 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1261/2497] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:58.192732 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.194863 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.262675 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8067cd5-a6eb-4d0c-8aa3-e1c108a023ae admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:58.266742 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9df18b-f258-48b6-a227-aa1e11649347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:58.267364 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df18b-f258-48b6-a227-aa1e11649347 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.267636 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df18b-f258-48b6-a227-aa1e11649347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.267901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9df18b-f258-48b6-a227-aa1e11649347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.278304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9df18b-f258-48b6-a227-aa1e11649347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:58.279757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9df18b-f258-48b6-a227-aa1e11649347 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.284285 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:04:58.292746 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1237/2498] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:04:58.513226 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.515017 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.548525 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b1418-1ff8-494c-bfd7-aa8140c1524a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:58.557830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:58.558491 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.558770 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.559045 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] PATH_INFO: `/v3/projects/9fc86cb4a7534998988c372fe48ece0e` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.560234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc86cb4a7534998988c372fe48ece0e)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:58.562324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.622046 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc86cb4a7534998988c372fe48ece0e', 'request_id': 'req-0faf4468-81f0-426f-8028-ec48747ee1c0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.630817 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc86cb4a7534998988c372fe48ece0e', 'request_id': 'req-0faf4468-81f0-426f-8028-ec48747ee1c0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.638760 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc86cb4a7534998988c372fe48ece0e', 'request_id': 'req-0faf4468-81f0-426f-8028-ec48747ee1c0'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.657008 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] The token cache is being invalidate because project 9fc86cb4a7534998988c372fe48ece0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:04:58.657511 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.658230 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-0faf4468-81f0-426f-8028-ec48747ee1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:04:58.660543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1262/2499] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:04:58 2022] DELETE /identity/v3/projects/9fc86cb4a7534998988c372fe48ece0e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:58.665970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeea11e-46c5-44b7-9f33-55f20593343c None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.666484 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeea11e-46c5-44b7-9f33-55f20593343c None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.666757 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeea11e-46c5-44b7-9f33-55f20593343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.690338 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-efeea11e-46c5-44b7-9f33-55f20593343c None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:58.691683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-efeea11e-46c5-44b7-9f33-55f20593343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.772708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1238/2500] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:58.784612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd00cd-04d9-448f-8b4f-a40c0540e70a None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.785064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd00cd-04d9-448f-8b4f-a40c0540e70a None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.785559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd00cd-04d9-448f-8b4f-a40c0540e70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.814637 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-cbfd00cd-04d9-448f-8b4f-a40c0540e70a None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:58.816559 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-cbfd00cd-04d9-448f-8b4f-a40c0540e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:58.835727 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1263/2501] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:58.836881 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeea11e-46c5-44b7-9f33-55f20593343c None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.854989 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeea11e-46c5-44b7-9f33-55f20593343c None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:58.861603 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:58.862412 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.862699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.863419 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.864177 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:04:58.864548 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:58.867384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.889473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1239/2502] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:04:58.890759 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd00cd-04d9-448f-8b4f-a40c0540e70a None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.902235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd00cd-04d9-448f-8b4f-a40c0540e70a None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:58.907555 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:58.910299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:58.910299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:58.910299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:58.910299 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:58.911601 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:58.943972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1264/2503] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:04:58 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:58.948377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:58.959781 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b0f5-9eef-4c90-8d46-e6807c7fa301 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.041518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.042196 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.042560 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.042873 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.043557 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.045874 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.076808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1240/2504] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:04:58 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:04:59.081333 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.093967 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73497a9-e03f-4fd4-a0b5-a33b42fbc6d0 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.099574 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.100290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.100568 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.100839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.101540 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.103204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.115620 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1265/2505] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:59.126725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.145054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba0797-2ee8-4f79-86d4-fe9bacee718e admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.153503 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1177a-7d15-4f74-9274-635f2cf7de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.154625 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1177a-7d15-4f74-9274-635f2cf7de85 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.155182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1177a-7d15-4f74-9274-635f2cf7de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.155663 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1177a-7d15-4f74-9274-635f2cf7de85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.156926 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1177a-7d15-4f74-9274-635f2cf7de85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.160167 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1177a-7d15-4f74-9274-635f2cf7de85 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.181979 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1241/2506] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:04:59.186415 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.199128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01899953-b91e-4a3f-88eb-0cc7626415de admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.203769 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.204460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.204732 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.205001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] PATH_INFO: `/v3/projects/fcd94944a0fa45beac88fa7b8810f7a0/users/2b1eedc496004343a58c57ebb9d821ac/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.224064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd94944a0fa45beac88fa7b8810f7a0, user_id=2b1eedc496004343a58c57ebb9d821ac, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.226912 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.244162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1266/2507] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:04:59 2022] PUT /identity/v3/projects/fcd94944a0fa45beac88fa7b8810f7a0/users/2b1eedc496004343a58c57ebb9d821ac/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:04:59.249395 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.249714 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.249981 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.272020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:04:59.273404 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:59.343896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1242/2508] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:04:59.354259 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:04:59.356246 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:04:59.425306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf29a8d-c2b6-4ed0-8074-0be26c2fa27d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:04:59.428992 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2932e-127f-4c34-b257-9ee0c6644b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:04:59.429656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2932e-127f-4c34-b257-9ee0c6644b05 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:04:59.429938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2932e-127f-4c34-b257-9ee0c6644b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:04:59.430210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2932e-127f-4c34-b257-9ee0c6644b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:04:59.440115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2932e-127f-4c34-b257-9ee0c6644b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:04:59.441616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2932e-127f-4c34-b257-9ee0c6644b05 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:04:59.452118 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1267/2509] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:05:01.303986 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:01.306001 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:01.320452 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:01.328469 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f8c79-ea7e-49c8-81ac-649e72dab1a3 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:01.339519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:01.340735 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:01.341198 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:01.341710 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] PATH_INFO: `/v3/users/60083226788d4b65ae091ce49a95b671` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:01.343702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60083226788d4b65ae091ce49a95b671)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:01.347422 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:01.419369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60083226788d4b65ae091ce49a95b671'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:01.435838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60083226788d4b65ae091ce49a95b671'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:01.436702 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60083226788d4b65ae091ce49a95b671'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:01.445107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60083226788d4b65ae091ce49a95b671'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:01.446552 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60083226788d4b65ae091ce49a95b671'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:01.461766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1243/2510] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:05:01 2022] DELETE /identity/v3/users/60083226788d4b65ae091ce49a95b671 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:05:01.467198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:01.467983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:01.468350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:01.491848 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:01.493965 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:01.505708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:01.566006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1268/2511] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:01.577699 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:01.579284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:01.659521 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cc46a6-4fbf-4adc-a004-c1316dad0967 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:01.663448 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:01.664076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:01.664350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:01.664643 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:01.675796 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:01.677265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:01.688136 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1244/2512] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:02.148153 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:02.149873 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:02.171835 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651a60c-9f0a-43f4-9df1-17ce56ed4585 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:02.184549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:02.185291 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:02.186218 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:02.189362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] PATH_INFO: `/v3/projects/44b012a1d3e2423ba90d7f7860f4b910` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:02.191310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b012a1d3e2423ba90d7f7860f4b910)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:02.193416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:02.308138 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b012a1d3e2423ba90d7f7860f4b910', 'request_id': 'req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.321481 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b012a1d3e2423ba90d7f7860f4b910', 'request_id': 'req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.334410 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b012a1d3e2423ba90d7f7860f4b910', 'request_id': 'req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.383204 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] The token cache is being invalidate because project 44b012a1d3e2423ba90d7f7860f4b910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:05:02.384349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.385715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.389558 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1269/2513] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:05:02 2022] DELETE /identity/v3/projects/44b012a1d3e2423ba90d7f7860f4b910 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:05:02.394588 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:02.409550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af2327-5363-4b57-8998-81cc94b3efce service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:02.495911 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:02.496897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:02.497269 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:02.498158 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] PATH_INFO: `/v3/users/ceab30f88b1c4fa1b6f558b56bf447af` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:02.500057 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceab30f88b1c4fa1b6f558b56bf447af)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:02.502265 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:02.566223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:02.629146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceab30f88b1c4fa1b6f558b56bf447af'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.655568 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceab30f88b1c4fa1b6f558b56bf447af'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.669951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceab30f88b1c4fa1b6f558b56bf447af'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.688237 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceab30f88b1c4fa1b6f558b56bf447af'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.689962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-4140bd4d-05bf-4227-b058-760af0c314ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceab30f88b1c4fa1b6f558b56bf447af'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:02.721549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1245/2514] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:05:02 2022] DELETE /identity/v3/users/ceab30f88b1c4fa1b6f558b56bf447af => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:03.185975 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.188632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:03.211207 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf1cb7-6f42-4d7e-b366-1d8dbb532b2a admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.319422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.320590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.321144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.322707 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] PATH_INFO: `/v3/projects/5ce2f161aa094f9796d185742ecb1b13` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.324905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ce2f161aa094f9796d185742ecb1b13)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.328073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.411931 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:03.423436 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ce2f161aa094f9796d185742ecb1b13', 'request_id': 'req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:03.439955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ce2f161aa094f9796d185742ecb1b13', 'request_id': 'req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:03.454744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ce2f161aa094f9796d185742ecb1b13', 'request_id': 'req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:03.485490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] The token cache is being invalidate because project 5ce2f161aa094f9796d185742ecb1b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:05:03.486115 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:03.487662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73d0cfa9-6951-4aeb-9625-2d32e9ae23ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:03.490205 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1270/2515] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:05:03 2022] DELETE /identity/v3/projects/5ce2f161aa094f9796d185742ecb1b13 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:03.495267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9acbb7-f976-43bb-a7f7-ed96b80e52d6 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.495836 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9acbb7-f976-43bb-a7f7-ed96b80e52d6 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.496080 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9acbb7-f976-43bb-a7f7-ed96b80e52d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.533953 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-8a9acbb7-f976-43bb-a7f7-ed96b80e52d6 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:03.536062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-8a9acbb7-f976-43bb-a7f7-ed96b80e52d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:03.619936 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1246/2516] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:03.636073 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68863-949d-4660-ae99-6d8e28b7a7a5 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.636352 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68863-949d-4660-ae99-6d8e28b7a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.636945 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b68863-949d-4660-ae99-6d8e28b7a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.674434 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-d5b68863-949d-4660-ae99-6d8e28b7a7a5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:03.677980 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d5b68863-949d-4660-ae99-6d8e28b7a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:03.692087 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1271/2517] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:03.697072 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9acbb7-f976-43bb-a7f7-ed96b80e52d6 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.710581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9acbb7-f976-43bb-a7f7-ed96b80e52d6 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.716227 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.716941 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.717226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.717550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.718221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:05:03.718513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.720373 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.735593 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1247/2518] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:05:03.740973 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b68863-949d-4660-ae99-6d8e28b7a7a5 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.758887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b68863-949d-4660-ae99-6d8e28b7a7a5 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.766446 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.767519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.768019 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.768608 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.769996 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.774064 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.820518 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1272/2519] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:05:03 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:03.826169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.839293 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea30ea9-9ecb-46f1-a4d8-841824dbabb6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:03.934970 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:03.936064 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:03.936549 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:03.936980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:03.938135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:03.941460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:03.976759 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1248/2520] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:05:03 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:03.983091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:03.998603 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5799f2f-77ac-4e52-bf08-07561f95c68d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:04.005651 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:04.006499 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:04.006909 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:04.007373 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:04.008537 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:04.012001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:04.032822 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1273/2521] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:05:04.038231 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:04.049188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bce38-73d4-4c07-987c-f228abe39205 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:04.055767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b3120-3fb9-473a-b2ae-2f3e669e94b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:04.056435 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3120-3fb9-473a-b2ae-2f3e669e94b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:04.056787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3120-3fb9-473a-b2ae-2f3e669e94b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:04.056973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b3120-3fb9-473a-b2ae-2f3e669e94b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:04.057678 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3120-3fb9-473a-b2ae-2f3e669e94b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:04.060245 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b3120-3fb9-473a-b2ae-2f3e669e94b2 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:04.073369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1249/2522] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:05:04.079269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:04.094489 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6da80-8433-45be-96c9-77bd1f4d2a9c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:04.100807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:04.101753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:04.102128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:04.102508 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] PATH_INFO: `/v3/projects/638024174ab94bf2a64d1c9db47796d6/users/ac330de8d85845b6b5cf0772f6704339/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:04.154930 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638024174ab94bf2a64d1c9db47796d6, user_id=ac330de8d85845b6b5cf0772f6704339, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:04.158338 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:04.193781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1274/2523] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:04 2022] PUT /identity/v3/projects/638024174ab94bf2a64d1c9db47796d6/users/ac330de8d85845b6b5cf0772f6704339/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:04.210487 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e3858-93f5-444c-ac97-ed9455c26815 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:04.210787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e3858-93f5-444c-ac97-ed9455c26815 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:04.211049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e3858-93f5-444c-ac97-ed9455c26815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:04.230025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:04.245031 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-a67e3858-93f5-444c-ac97-ed9455c26815 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:04.247045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a67e3858-93f5-444c-ac97-ed9455c26815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:04.368905 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1250/2524] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:04.380279 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:04.383007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:04.485353 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08cb74-3b6d-4433-8240-173cec3e1b61 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:04.489702 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:04.490501 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:04.491031 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:04.491402 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:04.513810 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:04.515761 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:04.534337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1275/2525] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:05:04.802968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16c5c-1cbf-4325-a1e8-77e278d7ebc4 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:04.802968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16c5c-1cbf-4325-a1e8-77e278d7ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:04.803662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f16c5c-1cbf-4325-a1e8-77e278d7ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:04.845003 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e5f16c5c-1cbf-4325-a1e8-77e278d7ebc4 None None] MFA Rules not processed for user `2b1eedc496004343a58c57ebb9d821ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:04.846505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e5f16c5c-1cbf-4325-a1e8-77e278d7ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:04.950505 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1251/2526] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:04.955632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:04.959161 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:04.993882 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af08316-270e-469a-b510-11281fa3a4e4 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.002490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.003426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.003898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.005122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.005369 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.009355 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.079689 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1276/2527] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:05:04 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:05:05.085125 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f16c5c-1cbf-4325-a1e8-77e278d7ebc4 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.107143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f16c5c-1cbf-4325-a1e8-77e278d7ebc4 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.203357 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.204461 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.204810 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.205114 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.206481 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.208583 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.243890 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1252/2528] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:05:05 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:05.247830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.262100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a140737-e46c-46f5-8954-2cb970195dfc admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.267631 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.268266 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.268547 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.268818 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.269517 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.271473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.283337 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1277/2529] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:05:05.287791 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.300191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d51ad9-b0bb-4316-be2b-614e9657b79b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.305032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.306339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.306339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.306339 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] PATH_INFO: `/v3/projects/1b88742960bb40eb84e65bedaacaceba/users/6d4cf34f6445448f980bac8e3ee1948c/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.322688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b88742960bb40eb84e65bedaacaceba, user_id=6d4cf34f6445448f980bac8e3ee1948c, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.325834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.335460 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:05.342608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1253/2530] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:05 2022] PUT /identity/v3/projects/1b88742960bb40eb84e65bedaacaceba/users/6d4cf34f6445448f980bac8e3ee1948c/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:05.346716 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.356938 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b64c3e-2ef8-4258-b9c9-584a9efaa85c admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.392515 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:05.425617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b09739-4f5a-44d6-96b9-505e670cc748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.426245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b09739-4f5a-44d6-96b9-505e670cc748 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.426530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b09739-4f5a-44d6-96b9-505e670cc748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.426802 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b09739-4f5a-44d6-96b9-505e670cc748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.427486 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b09739-4f5a-44d6-96b9-505e670cc748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.429147 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b09739-4f5a-44d6-96b9-505e670cc748 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.441510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1278/2531] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:05.445768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.457780 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaee41-a56b-4dd1-9482-2d8414175e44 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.462925 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.463594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.463859 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.465547 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] PATH_INFO: `/v3/projects/1b88742960bb40eb84e65bedaacaceba/users/6d4cf34f6445448f980bac8e3ee1948c/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.465694 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b282d58-6a98-48ca-ac73-497a21984517 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.465915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b282d58-6a98-48ca-ac73-497a21984517 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.466192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b282d58-6a98-48ca-ac73-497a21984517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.467656 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b88742960bb40eb84e65bedaacaceba, user_id=6d4cf34f6445448f980bac8e3ee1948c, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.470438 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.482751 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1254/2532] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:05 2022] PUT /identity/v3/projects/1b88742960bb40eb84e65bedaacaceba/users/6d4cf34f6445448f980bac8e3ee1948c/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:05.496250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7b282d58-6a98-48ca-ac73-497a21984517 None None] MFA Rules not processed for user `ac330de8d85845b6b5cf0772f6704339`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:05.497639 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7b282d58-6a98-48ca-ac73-497a21984517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:05.598630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1279/2533] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:05.600770 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.711000 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3824c-94b3-4a33-a452-b76f5375df69 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.726327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.727007 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.727288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.727556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.728191 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.730304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.760343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1255/2534] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:05:05 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:05.763899 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b282d58-6a98-48ca-ac73-497a21984517 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.779971 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b282d58-6a98-48ca-ac73-497a21984517 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.882254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.882993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.883159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.883424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.884111 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.886332 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.921290 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1280/2535] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:05:05 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:05:05.922615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.935211 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb958e-a587-4942-a24e-c511dad09057 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.942304 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.942988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.943274 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.943550 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:05.944391 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:05.946108 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:05.964434 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1256/2536] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:05.965948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:05.979311 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5802701-789c-4419-b6c3-12afee949ae9 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:05.986367 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:05.987092 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:05.987364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:05.987662 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] PATH_INFO: `/v3/projects/fd280ce6e21948379665f355665800db/users/ea4853f313eb4273b6d6d5fed2721ddc/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:06.006307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd280ce6e21948379665f355665800db, user_id=ea4853f313eb4273b6d6d5fed2721ddc, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:06.009088 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:06.022595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1281/2537] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:05 2022] PUT /identity/v3/projects/fd280ce6e21948379665f355665800db/users/ea4853f313eb4273b6d6d5fed2721ddc/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:06.026987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:06.037515 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549f000-14b0-4811-9663-91bc27d0da20 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:06.108123 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f815-8f5e-4aa4-8ad2-a0d01b86b51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:06.109020 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f815-8f5e-4aa4-8ad2-a0d01b86b51c admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:06.109297 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f815-8f5e-4aa4-8ad2-a0d01b86b51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:06.110829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f815-8f5e-4aa4-8ad2-a0d01b86b51c admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:06.111692 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f815-8f5e-4aa4-8ad2-a0d01b86b51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:06.113343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f815-8f5e-4aa4-8ad2-a0d01b86b51c admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:06.134334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1257/2538] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:06.135753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:06.147857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc524e0-0603-435c-80c6-bb1d6222a8c4 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:06.154038 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f58e-46ab-474b-a85f-78e59e0e2d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:06.155185 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f58e-46ab-474b-a85f-78e59e0e2d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:06.155461 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f58e-46ab-474b-a85f-78e59e0e2d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:06.155733 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f58e-46ab-474b-a85f-78e59e0e2d38 admin admin] PATH_INFO: `/v3/projects/fd280ce6e21948379665f355665800db/users/ea4853f313eb4273b6d6d5fed2721ddc/roles/16542b0f593541a195074d7863391bd7` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:06.157833 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9f58e-46ab-474b-a85f-78e59e0e2d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd280ce6e21948379665f355665800db, user_id=ea4853f313eb4273b6d6d5fed2721ddc, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:06.160652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f9f58e-46ab-474b-a85f-78e59e0e2d38 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:06.187897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1282/2539] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:06 2022] PUT /identity/v3/projects/fd280ce6e21948379665f355665800db/users/ea4853f313eb4273b6d6d5fed2721ddc/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:07.341789 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:07.342655 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:07.343104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:07.375369 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] MFA Rules not processed for user `ea4853f313eb4273b6d6d5fed2721ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:07.376555 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:07.428621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:07.468679 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1258/2540] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:07.470536 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78343e0-fdf4-43f2-8e1b-f0f8ddc59b0b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:07.471040 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78343e0-fdf4-43f2-8e1b-f0f8ddc59b0b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:07.471145 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78343e0-fdf4-43f2-8e1b-f0f8ddc59b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:07.492566 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f78343e0-fdf4-43f2-8e1b-f0f8ddc59b0b None None] MFA Rules not processed for user `ac330de8d85845b6b5cf0772f6704339`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:07.494359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f78343e0-fdf4-43f2-8e1b-f0f8ddc59b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:07.506955 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:07.600349 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1283/2541] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:07.617099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:07.619347 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:07.759951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b169071-27d4-40f1-9787-10cdf11dd607 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:07.768431 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e5bd5f8509b414c8699ec51117745cb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:07.769619 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:07.770088 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:07.770598 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:07.787441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:07.789178 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:07.801711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1259/2542] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:11.382718 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535878-d107-49ab-9d19-aa04127dd6ac None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:11.383874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535878-d107-49ab-9d19-aa04127dd6ac None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:11.384341 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31535878-d107-49ab-9d19-aa04127dd6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:11.424751 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-31535878-d107-49ab-9d19-aa04127dd6ac None None] MFA Rules not processed for user `6d4cf34f6445448f980bac8e3ee1948c`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:11.426131 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-31535878-d107-49ab-9d19-aa04127dd6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:11.529417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1284/2543] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:11.542918 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:11.544778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:11.613012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a92e2-9ba2-4ccb-aa42-c3be0a086662 service nova] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:11.617529 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '237bbe3771c249449b4c2cad20fa5ce4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:11.618608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:11.618608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:11.618875 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:11.691287 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:11.692838 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:11.703043 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1260/2544] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:11.847071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:11.847602 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:11.847879 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:11.869467 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:11.870820 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:11.932778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1285/2545] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:11.945962 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:11.947661 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:11.977025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=100 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:12.029723 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f5ea52-7d0f-46ff-82b4-17135602e6d0 service glance] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:12.040073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1396b-aaf7-4baf-9ec0-8cf6fe8d83c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:12.040972 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1396b-aaf7-4baf-9ec0-8cf6fe8d83c9 service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:12.041454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1396b-aaf7-4baf-9ec0-8cf6fe8d83c9 service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:12.041878 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1396b-aaf7-4baf-9ec0-8cf6fe8d83c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:12.052267 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1396b-aaf7-4baf-9ec0-8cf6fe8d83c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:12.053957 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1396b-aaf7-4baf-9ec0-8cf6fe8d83c9 service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:12.064683 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1261/2546] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:05:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:21.506390 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:21.507968 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:21.569265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:21.573795 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ab69e-2d13-498d-850d-c42c18b33e52 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:21.582959 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f822c8d-c4ed-4282-b8d3-6519141edf91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:21.583579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f822c8d-c4ed-4282-b8d3-6519141edf91 service cinder] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:21.583854 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f822c8d-c4ed-4282-b8d3-6519141edf91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:21.584146 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f822c8d-c4ed-4282-b8d3-6519141edf91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:21.589650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a02908-894b-4339-a146-64b9efa41ae5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:21.590340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a02908-894b-4339-a146-64b9efa41ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:21.590340 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a02908-894b-4339-a146-64b9efa41ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:21.596498 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f822c8d-c4ed-4282-b8d3-6519141edf91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:21.598196 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f822c8d-c4ed-4282-b8d3-6519141edf91 service cinder] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:21.609948 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1286/2547] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:21.612929 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-95a02908-894b-4339-a146-64b9efa41ae5 None None] MFA Rules not processed for user `2b1eedc496004343a58c57ebb9d821ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:21.614246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-95a02908-894b-4339-a146-64b9efa41ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:21.622106 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1262/2548] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:05:24.487251 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:24.487895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:24.487895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:24.523103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:24.524163 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:24.576470 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1287/2549] 10.222.0.52 () {58 vars in 1009 bytes} [Fri Oct 28 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:24.590049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a02908-894b-4339-a146-64b9efa41ae5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:24.629595 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a02908-894b-4339-a146-64b9efa41ae5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:24.635677 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:24.636310 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:24.636556 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:24.636823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:24.646313 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:24.647826 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:24.658156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1263/2550] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:05:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 28 20:05:34.573444 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=23 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:34.653504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=42 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:39.876457 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:39.878107 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:39.998393 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a3b86-e3e8-4db6-84e0-42d8272c89e2 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:40.003743 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:40.004445 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:40.004940 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:40.005406 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:40.007125 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:40.020531 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:40.022100 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:40.033399 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1288/2551] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:43.141238 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:43.202586 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab514b-2202-4c37-8355-49d3b011f8fa service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:43.206778 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:43.207456 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:43.207734 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:43.208013 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:43.218210 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:43.219644 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:43.230025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1264/2552] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:48.657987 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:48.669570 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0611f6-6de8-4f88-9893-e36e2bfb3dd6 service placement] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:48.676343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:48.676964 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:48.677235 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:48.678167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:48.680007 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:48.691891 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:48.693483 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:48.704412 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1289/2553] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:49.286532 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:49.378101 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2066b-df98-44e2-8177-6364d05226da service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:49.384090 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:49.384730 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:49.385008 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:49.385279 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] PATH_INFO: `/v3/users/ac330de8d85845b6b5cf0772f6704339` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:49.386564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac330de8d85845b6b5cf0772f6704339)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:49.388502 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:49.440227 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac330de8d85845b6b5cf0772f6704339'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.452335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac330de8d85845b6b5cf0772f6704339'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.452973 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac330de8d85845b6b5cf0772f6704339'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.460120 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac330de8d85845b6b5cf0772f6704339'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.460804 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac330de8d85845b6b5cf0772f6704339'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.474614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1265/2554] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:05:49 2022] DELETE /identity/v3/users/ac330de8d85845b6b5cf0772f6704339 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:49.663386 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:49.674654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24075611-14d9-40ee-8fc3-f502253c4917 service placement] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:49.738346 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:49.739139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:49.739416 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:49.739740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] PATH_INFO: `/v3/projects/638024174ab94bf2a64d1c9db47796d6` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:49.741121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638024174ab94bf2a64d1c9db47796d6)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:49.743054 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:49.803825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638024174ab94bf2a64d1c9db47796d6', 'request_id': 'req-ab9a6334-3688-4d15-9057-53137019ca25'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.816426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638024174ab94bf2a64d1c9db47796d6', 'request_id': 'req-ab9a6334-3688-4d15-9057-53137019ca25'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.823714 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:49.826546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638024174ab94bf2a64d1c9db47796d6', 'request_id': 'req-ab9a6334-3688-4d15-9057-53137019ca25'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.859289 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] The token cache is being invalidate because project 638024174ab94bf2a64d1c9db47796d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:05:49.859587 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.860257 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:49.861915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1290/2555] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:05:49 2022] DELETE /identity/v3/projects/638024174ab94bf2a64d1c9db47796d6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:49.866403 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:49.867901 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:49.877827 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:49.882129 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2b5d5-e567-4425-be3a-bed179152158 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:49.947829 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:49.948490 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:49.948768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:49.949065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] PATH_INFO: `/v3/users/ea4853f313eb4273b6d6d5fed2721ddc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:49.950291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4853f313eb4273b6d6d5fed2721ddc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:49.952332 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.007867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4853f313eb4273b6d6d5fed2721ddc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.023251 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4853f313eb4273b6d6d5fed2721ddc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.024076 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4853f313eb4273b6d6d5fed2721ddc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.032510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4853f313eb4273b6d6d5fed2721ddc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.033316 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-cd1c743e-890e-4ddc-ae19-dfe4492a2692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4853f313eb4273b6d6d5fed2721ddc'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.049830 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1266/2556] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:05:49 2022] DELETE /identity/v3/users/ea4853f313eb4273b6d6d5fed2721ddc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:50.241471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:50.243244 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:50.258121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a6334-3688-4d15-9057-53137019ca25 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:50.319496 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:50.320170 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.320426 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.320701 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] PATH_INFO: `/v3/projects/fd280ce6e21948379665f355665800db` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.321894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd280ce6e21948379665f355665800db)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:50.323840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.373271 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd280ce6e21948379665f355665800db', 'request_id': 'req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.380144 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd280ce6e21948379665f355665800db', 'request_id': 'req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.385865 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd280ce6e21948379665f355665800db', 'request_id': 'req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.399923 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] The token cache is being invalidate because project fd280ce6e21948379665f355665800db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81545) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:05:50.400302 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.400942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-9fe6d664-cc53-4cf7-b07c-77f7e2c0f601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:50.403619 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1291/2557] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:05:50 2022] DELETE /identity/v3/projects/fd280ce6e21948379665f355665800db => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:50.409834 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22aab2-a5cf-479a-868a-3a1d4f03e743 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.410362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22aab2-a5cf-479a-868a-3a1d4f03e743 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.410362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22aab2-a5cf-479a-868a-3a1d4f03e743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.480543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-7b22aab2-a5cf-479a-868a-3a1d4f03e743 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:50.481823 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7b22aab2-a5cf-479a-868a-3a1d4f03e743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:50.537284 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:50.555128 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1267/2558] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:50.564972 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d067b-1bee-4970-b8f5-dc7d25983821 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.565254 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d067b-1bee-4970-b8f5-dc7d25983821 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.565641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d067b-1bee-4970-b8f5-dc7d25983821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.591868 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-541d067b-1bee-4970-b8f5-dc7d25983821 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:50.593121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-541d067b-1bee-4970-b8f5-dc7d25983821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:50.601708 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1292/2559] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:50.606368 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22aab2-a5cf-479a-868a-3a1d4f03e743 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:50.617335 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22aab2-a5cf-479a-868a-3a1d4f03e743 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:50.622439 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:50.623052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.623325 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.623596 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] PATH_INFO: `/v3/domains` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.624246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81546) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:05:50.624543 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:50.626207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.638896 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1268/2560] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:05:50.644958 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d067b-1bee-4970-b8f5-dc7d25983821 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:50.654985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d067b-1bee-4970-b8f5-dc7d25983821 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:50.660615 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:50.661260 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.661571 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.661851 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.662485 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:50.664420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.694431 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1293/2561] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:05:50 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:50.698922 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:50.709825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed733f-520e-4384-a4ce-2c7a19ea9782 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:50.771824 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:50.772440 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.772711 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.772977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.773649 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:50.775562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.801562 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1269/2562] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:05:50 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:05:50.806030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:50.817506 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12348c-3c02-48c1-860a-d22c762b2b25 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:50.824630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:50.825510 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.825856 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.826253 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.827029 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:50.828852 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.839991 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1294/2563] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 28 20:05:50.844960 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:50.858553 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c7d0b-2180-47d2-b19b-3292fd013206 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:50.866951 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c754fcb-148a-476e-a117-2db9b73e717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:50.868122 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754fcb-148a-476e-a117-2db9b73e717f admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.868610 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754fcb-148a-476e-a117-2db9b73e717f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.869102 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c754fcb-148a-476e-a117-2db9b73e717f admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.870346 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754fcb-148a-476e-a117-2db9b73e717f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:50.873587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c754fcb-148a-476e-a117-2db9b73e717f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.887923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1270/2564] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:50.895071 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:50.908443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99388-054a-441a-b178-6aac0355e0f3 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:50.913569 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:50.914258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.914529 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.914799 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] PATH_INFO: `/v3/projects/fee916cf7f444c8681f65b4f24f4fa67/users/18dadfb6fe5a4cf7a18f5319f45edf24/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.931307 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee916cf7f444c8681f65b4f24f4fa67, user_id=18dadfb6fe5a4cf7a18f5319f45edf24, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:50.934041 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:50.950586 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1295/2565] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:50 2022] PUT /identity/v3/projects/fee916cf7f444c8681f65b4f24f4fa67/users/18dadfb6fe5a4cf7a18f5319f45edf24/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:50.962919 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13484e96-0776-47b0-bd72-1bc48998b6fb None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:50.963232 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13484e96-0776-47b0-bd72-1bc48998b6fb None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:50.963587 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13484e96-0776-47b0-bd72-1bc48998b6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:50.996978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-13484e96-0776-47b0-bd72-1bc48998b6fb None None] MFA Rules not processed for user `18dadfb6fe5a4cf7a18f5319f45edf24`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:50.998323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-13484e96-0776-47b0-bd72-1bc48998b6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:51.073572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1271/2566] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:51.079319 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:51.084063 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:51.158826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b801a-4c55-42f5-85d5-6cab16dee5b1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:51.163781 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:51.164413 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.164697 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.164969 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.165648 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:51.167595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:51.199584 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1296/2567] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:05:51 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:51.203651 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13484e96-0776-47b0-bd72-1bc48998b6fb None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:51.219475 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13484e96-0776-47b0-bd72-1bc48998b6fb None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:51.276822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:51.291152 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:51.291763 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.292032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.292298 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] PATH_INFO: `/v3/users` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.292942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:51.294871 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:51.320454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1272/2568] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:05:51 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:51.324859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:51.335634 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5809817-c6b1-4a4c-a412-652d392e95d1 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:51.340330 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:51.340928 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.341210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.341505 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.342180 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:51.343771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:51.354845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1297/2569] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:51.359650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:51.370467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db382c-9e70-45eb-ac30-efda63d0e7cc admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:51.375708 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:51.376384 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.376647 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.377052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] PATH_INFO: `/v3/projects/5d77ea89596845f9927d66213c02e5c6/users/305909ff2e2d483fa19dff102bebafcc/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.396837 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d77ea89596845f9927d66213c02e5c6, user_id=305909ff2e2d483fa19dff102bebafcc, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:51.400577 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:51.417988 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1273/2570] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:51 2022] PUT /identity/v3/projects/5d77ea89596845f9927d66213c02e5c6/users/305909ff2e2d483fa19dff102bebafcc/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:51.422956 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:51.433915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdefc9c-62b8-439a-8e1f-d1858bd725bf admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:51.497915 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd968c7-fabe-4ac2-809d-04d5e86edc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:51.498546 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd968c7-fabe-4ac2-809d-04d5e86edc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.498826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd968c7-fabe-4ac2-809d-04d5e86edc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.499119 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd968c7-fabe-4ac2-809d-04d5e86edc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.499767 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd968c7-fabe-4ac2-809d-04d5e86edc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:51.501460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd968c7-fabe-4ac2-809d-04d5e86edc74 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:51.512422 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1298/2571] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:51.516897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:51.528510 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610c885-a041-4773-94bc-242c88fd1bba admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:51.534445 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:51.535144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.535402 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.535806 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] PATH_INFO: `/v3/projects/5d77ea89596845f9927d66213c02e5c6/users/305909ff2e2d483fa19dff102bebafcc/roles/16542b0f593541a195074d7863391bd7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.538040 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d77ea89596845f9927d66213c02e5c6, user_id=305909ff2e2d483fa19dff102bebafcc, role_id=16542b0f593541a195074d7863391bd7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:51.540698 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:51.553654 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1274/2572] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:51 2022] PUT /identity/v3/projects/5d77ea89596845f9927d66213c02e5c6/users/305909ff2e2d483fa19dff102bebafcc/roles/16542b0f593541a195074d7863391bd7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:51.627520 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6e436-9bdd-4274-a06e-13c0d39d2cfe None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.627796 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6e436-9bdd-4274-a06e-13c0d39d2cfe None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.627936 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6e436-9bdd-4274-a06e-13c0d39d2cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.660460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-39f6e436-9bdd-4274-a06e-13c0d39d2cfe None None] MFA Rules not processed for user `305909ff2e2d483fa19dff102bebafcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:51.661778 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-39f6e436-9bdd-4274-a06e-13c0d39d2cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:51.734845 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:51.741287 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1299/2573] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:51.752843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:51.754768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:51.844956 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc62d5-f078-4dd6-a5eb-9fad67c10dab admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:51.849010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64ac65-7e36-4d9c-8066-5dc70299ed9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:51.849646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64ac65-7e36-4d9c-8066-5dc70299ed9c service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:51.849942 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64ac65-7e36-4d9c-8066-5dc70299ed9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:51.850207 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64ac65-7e36-4d9c-8066-5dc70299ed9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:51.912437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64ac65-7e36-4d9c-8066-5dc70299ed9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:51.913907 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64ac65-7e36-4d9c-8066-5dc70299ed9c service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:51.923514 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1275/2574] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:54.543105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6e436-9bdd-4274-a06e-13c0d39d2cfe None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:54.614993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6e436-9bdd-4274-a06e-13c0d39d2cfe None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:54.620364 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:54.621030 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:54.621306 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:54.621600 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] PATH_INFO: `/v3/users/18dadfb6fe5a4cf7a18f5319f45edf24` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:54.622773 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] RBAC: Authorizing `identity:delete_user(user_id=18dadfb6fe5a4cf7a18f5319f45edf24)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:54.624715 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:54.683222 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18dadfb6fe5a4cf7a18f5319f45edf24'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:54.684006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18dadfb6fe5a4cf7a18f5319f45edf24'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:54.684744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18dadfb6fe5a4cf7a18f5319f45edf24'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:54.698703 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18dadfb6fe5a4cf7a18f5319f45edf24'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:54.705675 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18dadfb6fe5a4cf7a18f5319f45edf24'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:54.725589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1300/2575] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:05:54 2022] DELETE /identity/v3/users/18dadfb6fe5a4cf7a18f5319f45edf24 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:54.730766 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:54.731488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:54.731488 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:54.751767 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:54.752963 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:54.785450 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:54.819720 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1276/2576] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:54.830806 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:54.832335 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:54.921706 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105e969-118a-4e84-90f4-eb481968659e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:54.926060 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:54.926726 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:54.927034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:54.927310 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:54.937519 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:54.938983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:54.944151 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:54.949623 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1301/2577] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:55.228323 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:55.229882 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:55.242574 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e15a31-e988-499c-bf2c-3e5d6360823f None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:55.249054 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:55.249852 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:55.250189 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:55.250517 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] PATH_INFO: `/v3/projects/fee916cf7f444c8681f65b4f24f4fa67` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:55.251800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee916cf7f444c8681f65b4f24f4fa67)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:55.253879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:55.315370 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee916cf7f444c8681f65b4f24f4fa67', 'request_id': 'req-7033dfc6-8091-404c-af9d-4be3f0752275'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.325467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee916cf7f444c8681f65b4f24f4fa67', 'request_id': 'req-7033dfc6-8091-404c-af9d-4be3f0752275'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.332897 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee916cf7f444c8681f65b4f24f4fa67', 'request_id': 'req-7033dfc6-8091-404c-af9d-4be3f0752275'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.346660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] The token cache is being invalidate because project fee916cf7f444c8681f65b4f24f4fa67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:05:55.346968 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.347648 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.349406 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1277/2578] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:05:55 2022] DELETE /identity/v3/projects/fee916cf7f444c8681f65b4f24f4fa67 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:55.353282 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:55.364159 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82764de5-2269-4648-a454-fb3b59b1e0cf service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:55.427265 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:55.428198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:55.428720 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:55.429136 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] PATH_INFO: `/v3/users/305909ff2e2d483fa19dff102bebafcc` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:55.430906 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=305909ff2e2d483fa19dff102bebafcc)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:55.434293 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:55.498184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305909ff2e2d483fa19dff102bebafcc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.498855 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305909ff2e2d483fa19dff102bebafcc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.499592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305909ff2e2d483fa19dff102bebafcc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.511771 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305909ff2e2d483fa19dff102bebafcc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.520068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a19554af-f7d0-4d0a-b7df-0cff90f7ad2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305909ff2e2d483fa19dff102bebafcc'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.536831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1302/2579] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:05:55 2022] DELETE /identity/v3/users/305909ff2e2d483fa19dff102bebafcc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:05:55.835074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:55.836779 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:55.851437 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033dfc6-8091-404c-af9d-4be3f0752275 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:55.912855 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:55.913421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:55.913703 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:55.913977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] PATH_INFO: `/v3/projects/5d77ea89596845f9927d66213c02e5c6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:55.915141 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d77ea89596845f9927d66213c02e5c6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:55.917050 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:55.981331 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d77ea89596845f9927d66213c02e5c6', 'request_id': 'req-8b22250c-4bf1-4412-863a-4e781cbc97f1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.990074 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d77ea89596845f9927d66213c02e5c6', 'request_id': 'req-8b22250c-4bf1-4412-863a-4e781cbc97f1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:55.995017 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:55.996446 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d77ea89596845f9927d66213c02e5c6', 'request_id': 'req-8b22250c-4bf1-4412-863a-4e781cbc97f1'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:56.010935 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] The token cache is being invalidate because project 5d77ea89596845f9927d66213c02e5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:05:56.011223 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:56.011856 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-8b22250c-4bf1-4412-863a-4e781cbc97f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:05:56.013478 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1278/2580] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:05:55 2022] DELETE /identity/v3/projects/5d77ea89596845f9927d66213c02e5c6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:05:56.018635 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efce2-ee73-4742-bda9-98c18518387b None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.019167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efce2-ee73-4742-bda9-98c18518387b None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.019167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1efce2-ee73-4742-bda9-98c18518387b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.038986 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-fc1efce2-ee73-4742-bda9-98c18518387b None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:56.040199 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-fc1efce2-ee73-4742-bda9-98c18518387b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:56.103713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1303/2581] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:56.112229 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96784-fa8c-4141-8b1b-f457d99110dc None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.112544 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96784-fa8c-4141-8b1b-f457d99110dc None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.112819 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b96784-fa8c-4141-8b1b-f457d99110dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.136291 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-d6b96784-fa8c-4141-8b1b-f457d99110dc None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:56.137564 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-d6b96784-fa8c-4141-8b1b-f457d99110dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:56.147184 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1279/2582] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:56.151753 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1efce2-ee73-4742-bda9-98c18518387b None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:56.162162 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1efce2-ee73-4742-bda9-98c18518387b None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:56.167831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:56.168447 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.168724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.169072 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.170023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:05:56.170471 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:56.173269 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:56.189128 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1304/2583] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:05:56.193978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b96784-fa8c-4141-8b1b-f457d99110dc None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:56.203985 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b96784-fa8c-4141-8b1b-f457d99110dc None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:56.209899 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:56.210513 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.210787 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.211053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.211684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:56.213725 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:56.244617 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1280/2584] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:05:56 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:05:56.249121 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:56.260176 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6446b-d659-417e-bab5-6e01d07e52f8 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:56.264329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:05:56.323389 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:56.324022 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.324328 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.324595 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.325248 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:56.327359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:56.351276 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1305/2585] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:05:56 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 28 20:05:56.355923 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:56.371374 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01da6-9b03-44f8-ba10-33cda8387e4f admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:56.377518 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:56.378145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.378421 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.378674 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.379350 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:56.381048 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:56.393396 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1281/2586] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:56.397696 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:56.408535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ce3ea-16bb-4f94-bca3-7caa8175541e admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:56.414001 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee78e47-7630-48c8-b8b6-6f9bf981cfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:56.414740 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee78e47-7630-48c8-b8b6-6f9bf981cfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.414885 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee78e47-7630-48c8-b8b6-6f9bf981cfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.415177 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee78e47-7630-48c8-b8b6-6f9bf981cfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.416862 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee78e47-7630-48c8-b8b6-6f9bf981cfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:56.417807 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee78e47-7630-48c8-b8b6-6f9bf981cfa1 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:56.430192 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1306/2587] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:05:56.434783 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:56.445594 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915335b-92d9-4303-ab19-0910f85308d6 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:56.451246 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:56.451938 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.452174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.452441 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] PATH_INFO: `/v3/projects/724b85217c52480a85dda5ae61923dd6/users/467d145485704c17ba43affeb273a6c3/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.468740 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=724b85217c52480a85dda5ae61923dd6, user_id=467d145485704c17ba43affeb273a6c3, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:56.471519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:56.487049 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1282/2588] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:05:56 2022] PUT /identity/v3/projects/724b85217c52480a85dda5ae61923dd6/users/467d145485704c17ba43affeb273a6c3/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 28 20:05:56.497551 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6f9f4-89bb-406a-8f36-5531b4a9b318 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.497840 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6f9f4-89bb-406a-8f36-5531b4a9b318 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.498143 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6f9f4-89bb-406a-8f36-5531b4a9b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.530857 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-baf6f9f4-89bb-406a-8f36-5531b4a9b318 None None] MFA Rules not processed for user `467d145485704c17ba43affeb273a6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:05:56.532150 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-baf6f9f4-89bb-406a-8f36-5531b4a9b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:56.728273 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1307/2589] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:05:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:05:56.742662 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:05:56.744471 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:05:56.807416 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a103c-25d9-409b-be9d-1cba9a7fbe4b admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:05:56.811482 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea532c4-7dab-4457-87ee-ba86fd3fe069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:05:56.812099 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea532c4-7dab-4457-87ee-ba86fd3fe069 service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:05:56.812376 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea532c4-7dab-4457-87ee-ba86fd3fe069 service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:05:56.812646 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea532c4-7dab-4457-87ee-ba86fd3fe069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:05:56.822928 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea532c4-7dab-4457-87ee-ba86fd3fe069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:05:56.824620 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea532c4-7dab-4457-87ee-ba86fd3fe069 service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:05:56.834018 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1283/2590] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:05:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:05:59.935167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6f9f4-89bb-406a-8f36-5531b4a9b318 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:00.009157 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6f9f4-89bb-406a-8f36-5531b4a9b318 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:00.014744 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:00.015359 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.015664 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.015916 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] PATH_INFO: `/v3/users/467d145485704c17ba43affeb273a6c3` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.017210 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] RBAC: Authorizing `identity:delete_user(user_id=467d145485704c17ba43affeb273a6c3)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:00.019184 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:00.036564 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:00.077828 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467d145485704c17ba43affeb273a6c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.078504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467d145485704c17ba43affeb273a6c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.079130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467d145485704c17ba43affeb273a6c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.091905 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467d145485704c17ba43affeb273a6c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.099139 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467d145485704c17ba43affeb273a6c3'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.113983 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1308/2591] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:05:59 2022] DELETE /identity/v3/users/467d145485704c17ba43affeb273a6c3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:06:00.119545 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.120052 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.120163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.142739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:06:00.144030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:00.210609 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1284/2592] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:06:00.222894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:00.224590 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:00.298554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bd439-dd78-498f-adf5-8d2b1b72f8da admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:00.302544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68148c02-184b-448d-97e3-3586e6141cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:00.303294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148c02-184b-448d-97e3-3586e6141cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.303544 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148c02-184b-448d-97e3-3586e6141cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.303811 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148c02-184b-448d-97e3-3586e6141cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.313477 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68148c02-184b-448d-97e3-3586e6141cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:00.314892 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68148c02-184b-448d-97e3-3586e6141cc2 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:00.325553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1309/2593] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:06:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:06:00.632895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:00.634580 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:00.647377 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b5a1f-db31-4d73-8f06-921391aebc50 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:00.663244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:00.663244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.663244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.663244 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] PATH_INFO: `/v3/projects/724b85217c52480a85dda5ae61923dd6` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.664145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724b85217c52480a85dda5ae61923dd6)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:00.664145 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:00.696083 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:00.730045 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724b85217c52480a85dda5ae61923dd6', 'request_id': 'req-f951244c-60b1-428c-b36d-3c0658fa0677'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.736984 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724b85217c52480a85dda5ae61923dd6', 'request_id': 'req-f951244c-60b1-428c-b36d-3c0658fa0677'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.743113 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724b85217c52480a85dda5ae61923dd6', 'request_id': 'req-f951244c-60b1-428c-b36d-3c0658fa0677'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.758567 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] The token cache is being invalidate because project 724b85217c52480a85dda5ae61923dd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:06:00.758843 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.759508 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-f951244c-60b1-428c-b36d-3c0658fa0677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:00.760995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1285/2594] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:06:00 2022] DELETE /identity/v3/projects/724b85217c52480a85dda5ae61923dd6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:06:00.767342 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df1984-a49d-4385-a079-ef624776e0f4 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.767893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df1984-a49d-4385-a079-ef624776e0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.768974 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df1984-a49d-4385-a079-ef624776e0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.793343 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-b0df1984-a49d-4385-a079-ef624776e0f4 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:06:00.794572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-b0df1984-a49d-4385-a079-ef624776e0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:00.858490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1310/2595] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 28 20:06:00.868623 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8ce18-a4cc-457f-8ef2-12f41bf40c68 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.869035 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8ce18-a4cc-457f-8ef2-12f41bf40c68 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.869454 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8ce18-a4cc-457f-8ef2-12f41bf40c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.892857 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-1fc8ce18-a4cc-457f-8ef2-12f41bf40c68 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:06:00.894143 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-1fc8ce18-a4cc-457f-8ef2-12f41bf40c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:00.903036 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1286/2596] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:06:00.907621 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df1984-a49d-4385-a079-ef624776e0f4 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:00.918065 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df1984-a49d-4385-a079-ef624776e0f4 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:00.922999 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:00.923616 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.923894 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.924167 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] PATH_INFO: `/v3/domains` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.924831 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81545) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 28 20:06:00.925130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:00.926774 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:00.939424 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1311/2597] 10.222.0.52 () {58 vars in 1153 bytes} [Fri Oct 28 20:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 28 20:06:00.944660 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8ce18-a4cc-457f-8ef2-12f41bf40c68 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:00.954459 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8ce18-a4cc-457f-8ef2-12f41bf40c68 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:00.960388 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:00.961019 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:00.961296 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:00.961589 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:00.962226 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:00.964135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:00.996171 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1287/2598] 10.222.0.52 () {60 vars in 1153 bytes} [Fri Oct 28 20:06:00 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:06:01.000985 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:01.012443 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cd11f-71e7-40f5-b0eb-b870a616557d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:01.037713 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:01.084630 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:01.085250 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:01.085557 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:01.085826 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] PATH_INFO: `/v3/users` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:01.086460 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:01.088397 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:01.110895 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1312/2599] 10.222.0.52 () {60 vars in 1144 bytes} [Fri Oct 28 20:06:00 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 28 20:06:01.115500 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:01.127868 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486363a-ccf9-4a96-bd56-3d18ce4e6d29 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:01.133189 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:01.133987 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:01.134281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:01.134572 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:01.135504 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:01.137537 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:01.156886 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1288/2600] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:06:01.162767 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:01.174275 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ddea10-e7c4-4bed-86a5-803f387daca2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:01.180549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799c51a-8a9a-471d-b25e-3af585ef0526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:01.181227 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c51a-8a9a-471d-b25e-3af585ef0526 admin admin] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:01.181654 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c51a-8a9a-471d-b25e-3af585ef0526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:01.181954 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799c51a-8a9a-471d-b25e-3af585ef0526 admin admin] PATH_INFO: `/v3/roles` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:01.182641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c51a-8a9a-471d-b25e-3af585ef0526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:01.184329 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799c51a-8a9a-471d-b25e-3af585ef0526 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:01.195772 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1313/2601] 10.222.0.52 () {58 vars in 1122 bytes} [Fri Oct 28 20:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 28 20:06:01.200752 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:01.211978 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a76dad-a593-4a17-93a6-6e90852232fb admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:01.218065 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:01.218733 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] REQUEST_METHOD: `PUT` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:01.219010 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:01.219288 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] PATH_INFO: `/v3/projects/73d76885805a4e239c11282cc2abc1cc/users/c2b4968091d14b2eb1b2700f22383d0f/roles/1df8c96377614e95b2f2fa089b4631f4` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:01.240608 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d76885805a4e239c11282cc2abc1cc, user_id=c2b4968091d14b2eb1b2700f22383d0f, role_id=1df8c96377614e95b2f2fa089b4631f4)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:01.243467 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:01.258079 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1289/2602] 10.222.0.52 () {60 vars in 1483 bytes} [Fri Oct 28 20:06:01 2022] PUT /identity/v3/projects/73d76885805a4e239c11282cc2abc1cc/users/c2b4968091d14b2eb1b2700f22383d0f/roles/1df8c96377614e95b2f2fa089b4631f4 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:06:01.269535 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d5e25-b927-4945-a0d8-459b8e6e6c1f None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:01.269839 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d5e25-b927-4945-a0d8-459b8e6e6c1f None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:01.270198 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d5e25-b927-4945-a0d8-459b8e6e6c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:01.300264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-7f5d5e25-b927-4945-a0d8-459b8e6e6c1f None None] MFA Rules not processed for user `c2b4968091d14b2eb1b2700f22383d0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:06:01.301576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-7f5d5e25-b927-4945-a0d8-459b8e6e6c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:01.380554 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1314/2603] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:06:01.392261 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:01.394053 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:01.454185 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662579da-6ca2-4b5b-b7fa-275992ce22db admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:01.458420 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab4b66-a72f-4f8b-8b75-d4bd7583e13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e609d787cb964803b2630895f155a2c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:01.459025 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4b66-a72f-4f8b-8b75-d4bd7583e13f service cinder] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:01.459328 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4b66-a72f-4f8b-8b75-d4bd7583e13f service cinder] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:01.459657 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab4b66-a72f-4f8b-8b75-d4bd7583e13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:01.469361 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab4b66-a72f-4f8b-8b75-d4bd7583e13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:01.470800 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab4b66-a72f-4f8b-8b75-d4bd7583e13f service cinder] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:01.480413 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1290/2604] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:06:01 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:06:06.600360 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d5e25-b927-4945-a0d8-459b8e6e6c1f None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:06.664324 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d5e25-b927-4945-a0d8-459b8e6e6c1f None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:06.669680 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:06.670314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:06.670589 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:06.670858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] PATH_INFO: `/v3/users/c2b4968091d14b2eb1b2700f22383d0f` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:06.671993 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b4968091d14b2eb1b2700f22383d0f)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:06.673962 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:06.719887 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:06.735105 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b4968091d14b2eb1b2700f22383d0f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:06.736261 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b4968091d14b2eb1b2700f22383d0f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:06.737264 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b4968091d14b2eb1b2700f22383d0f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:06.751068 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b4968091d14b2eb1b2700f22383d0f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:06.758638 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b4968091d14b2eb1b2700f22383d0f'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:06.773834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1315/2605] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:06:06 2022] DELETE /identity/v3/users/c2b4968091d14b2eb1b2700f22383d0f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:06:06.778684 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] REQUEST_METHOD: `POST` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:06.779174 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:06.779281 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:06.798861 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.auth.core [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] MFA Rules not processed for user `b9dddedf69f943debb0792966846ece1`. Rule list: `[]` (Enabled: `True`). {{(pid=81546) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:06:06.800004 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:06.850851 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:06.867669 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1291/2606] 10.222.0.52 () {58 vars in 958 bytes} [Fri Oct 28 20:06:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:06:06.877949 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:06.879475 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:06.942345 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c41c7-183e-43c3-841f-6ed7751f3ddd admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:06.946853 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:06.947450 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:06.947724 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:06.947970 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:06.957579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:06.959006 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:06.968494 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1316/2607] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:06:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:06:07.261915 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:07.263585 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:07.277427 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5867cff2-56ab-46ed-b3a8-5124aa83c4e5 None None] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:07.283014 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:07.283696 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:07.283940 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:07.284213 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] PATH_INFO: `/v3/projects/73d76885805a4e239c11282cc2abc1cc` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:07.285327 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d76885805a4e239c11282cc2abc1cc)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:07.288828 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:07.339949 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d76885805a4e239c11282cc2abc1cc', 'request_id': 'req-0696cb22-2b61-4674-b140-20c3396e6496'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:07.346234 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d76885805a4e239c11282cc2abc1cc', 'request_id': 'req-0696cb22-2b61-4674-b140-20c3396e6496'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:07.351822 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d76885805a4e239c11282cc2abc1cc', 'request_id': 'req-0696cb22-2b61-4674-b140-20c3396e6496'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:07.366219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] The token cache is being invalidate because project 73d76885805a4e239c11282cc2abc1cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:06:07.366506 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:07.367119 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:06:07.368642 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1292/2608] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:06:07 2022] DELETE /identity/v3/projects/73d76885805a4e239c11282cc2abc1cc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:06:16.964378 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=42,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:17.363263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:27.401984 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:27.403533 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:27.416314 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172a7cd-d414-40cd-b1b9-ce59e39b8f2d service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:27.466572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480361f6-0a76-4df5-a6f1-97f338ba36c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:27.467193 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480361f6-0a76-4df5-a6f1-97f338ba36c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:27.467441 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480361f6-0a76-4df5-a6f1-97f338ba36c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:27.467710 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480361f6-0a76-4df5-a6f1-97f338ba36c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:27.469523 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-480361f6-0a76-4df5-a6f1-97f338ba36c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:27.479825 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480361f6-0a76-4df5-a6f1-97f338ba36c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:27.481656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480361f6-0a76-4df5-a6f1-97f338ba36c1 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:27.491028 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1317/2609] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:06:27.587343 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:06:27.588921 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:27.607473 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0696cb22-2b61-4674-b140-20c3396e6496 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:06:27.612133 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:06:27.612768 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:06:27.613047 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:06:27.613300 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:06:27.615146 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:06:27.703895 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:06:27.705408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:06:27.727206 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1293/2610] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:06:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:06:37.486898 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=26 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:06:37.724147 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=43 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:06.223301 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] REQUEST_METHOD: `POST` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:06.223793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:06.223914 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:06.255051 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.auth.core [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] MFA Rules not processed for user `9b5124cfd2724ed1a5fba427dbe3031e`. Rule list: `[]` (Enabled: `True`). {{(pid=81545) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 28 20:07:06.256245 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:06.313258 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1318/2611] 10.222.0.52 () {58 vars in 967 bytes} [Fri Oct 28 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 28 20:07:06.364188 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:06.365738 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:06.437062 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e3f0d-1645-4117-b0e3-76a47f466e05 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:06.442362 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5eb5a6ff4af64a9980bcaa49f3c97bba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:06.442990 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:06.443263 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:06.443533 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:06.451991 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:06.453621 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:06.462597 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1294/2612] 10.222.0.52 () {60 vars in 1384 bytes} [Fri Oct 28 20:07:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 28 20:07:13.242130 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:13.243671 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:13.314897 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945166-c16c-4e11-8967-eb89fcc88208 None None] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:13.320208 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:13.320858 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:13.321134 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:13.321437 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] PATH_INFO: `/v3/users/2b1eedc496004343a58c57ebb9d821ac` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:13.322830 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1eedc496004343a58c57ebb9d821ac)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:13.327666 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:13.391008 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1eedc496004343a58c57ebb9d821ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.391927 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1eedc496004343a58c57ebb9d821ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.392874 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1eedc496004343a58c57ebb9d821ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.409834 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1eedc496004343a58c57ebb9d821ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.418472 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1eedc496004343a58c57ebb9d821ac'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.435034 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1319/2613] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:07:13 2022] DELETE /identity/v3/users/2b1eedc496004343a58c57ebb9d821ac => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:13.629816 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:13.641037 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf60671-668e-46fc-afdc-715d9efc816d service swift] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:13.700879 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:13.701535 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:13.701808 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:13.702073 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] PATH_INFO: `/v3/projects/fcd94944a0fa45beac88fa7b8810f7a0` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:13.703204 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd94944a0fa45beac88fa7b8810f7a0)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:13.705109 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:13.761144 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd94944a0fa45beac88fa7b8810f7a0', 'request_id': 'req-9db65df1-a240-48bf-b1a7-0d1a6d05de83'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.767790 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd94944a0fa45beac88fa7b8810f7a0', 'request_id': 'req-9db65df1-a240-48bf-b1a7-0d1a6d05de83'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.773937 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd94944a0fa45beac88fa7b8810f7a0', 'request_id': 'req-9db65df1-a240-48bf-b1a7-0d1a6d05de83'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.789825 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] The token cache is being invalidate because project fcd94944a0fa45beac88fa7b8810f7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:07:13.790449 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.791135 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.793059 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1295/2614] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:07:13 2022] DELETE /identity/v3/projects/fcd94944a0fa45beac88fa7b8810f7a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:13.797262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:13.798793 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:13.812137 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e742af-6343-43d4-81cd-44f1fffbd20d admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:13.823833 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:13.875922 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:13.876553 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:13.876841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:13.877104 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] PATH_INFO: `/v3/users/6d4cf34f6445448f980bac8e3ee1948c` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:13.878327 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4cf34f6445448f980bac8e3ee1948c)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:13.880236 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:13.932122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4cf34f6445448f980bac8e3ee1948c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.932841 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4cf34f6445448f980bac8e3ee1948c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.933504 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4cf34f6445448f980bac8e3ee1948c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.946047 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4cf34f6445448f980bac8e3ee1948c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.953579 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4cf34f6445448f980bac8e3ee1948c'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:13.969684 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1320/2615] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:07:13 2022] DELETE /identity/v3/users/6d4cf34f6445448f980bac8e3ee1948c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:14.169867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:14.171616 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:14.189182 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db65df1-a240-48bf-b1a7-0d1a6d05de83 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:14.207712 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:14.255812 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:14.256448 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:14.256724 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:14.256995 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] PATH_INFO: `/v3/projects/1b88742960bb40eb84e65bedaacaceba` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:14.258156 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b88742960bb40eb84e65bedaacaceba)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:14.260192 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:14.309542 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b88742960bb40eb84e65bedaacaceba', 'request_id': 'req-db138419-1cbb-4320-b1e2-5cc076bcf1f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.316163 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b88742960bb40eb84e65bedaacaceba', 'request_id': 'req-db138419-1cbb-4320-b1e2-5cc076bcf1f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.322408 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b88742960bb40eb84e65bedaacaceba', 'request_id': 'req-db138419-1cbb-4320-b1e2-5cc076bcf1f8'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.337462 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] The token cache is being invalidate because project 1b88742960bb40eb84e65bedaacaceba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:07:14.337688 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.338329 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:14.339867 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1296/2616] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:07:14 2022] DELETE /identity/v3/projects/1b88742960bb40eb84e65bedaacaceba => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:23.966039 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=46,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:24.333839 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:49.149803 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:49.151572 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:49.211323 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a7d7f-9569-4942-9d3b-1d8f6eb8ad50 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:49.263473 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:49.264091 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:49.264371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:49.264641 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:49.266549 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:49.339371 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:49.340746 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:49.353632 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1321/2617] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:07:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:07:50.547615 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:50.549242 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:50.562203 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138419-1cbb-4320-b1e2-5cc076bcf1f8 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:50.566493 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7157e60fb6fb4b84866ce59f051a9037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:50.567104 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] REQUEST_METHOD: `GET` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:50.567400 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:50.567658 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:50.569526 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:50.583904 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:50.585345 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:50.597091 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1297/2618] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:07:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 28 20:07:58.604484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:58.606543 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:58.678340 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=100 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:58.682576 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d9bb4-100a-42d3-b015-1c7b401ec2c3 service neutron] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:58.687394 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:58.688023 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:58.688294 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:58.688561 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] PATH_INFO: `/v3/users/c0231f6289fb459a9b8249ad29a0b191` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:58.689685 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0231f6289fb459a9b8249ad29a0b191)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:58.691626 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:58.744942 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0231f6289fb459a9b8249ad29a0b191'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:58.745484 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0231f6289fb459a9b8249ad29a0b191'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:58.746262 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0231f6289fb459a9b8249ad29a0b191'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:58.759122 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0231f6289fb459a9b8249ad29a0b191'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:58.766127 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0231f6289fb459a9b8249ad29a0b191'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:58.780813 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1322/2619] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:07:58 2022] DELETE /identity/v3/users/c0231f6289fb459a9b8249ad29a0b191 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:58.967334 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:58.978219 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc200e3a-f802-45ca-a1d5-86777b607125 service neutron] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:59.038378 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:59.038997 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:59.039268 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:59.039539 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] PATH_INFO: `/v3/projects/cd2459c93dd24a808436139c866a420f` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:59.041027 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd2459c93dd24a808436139c866a420f)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:59.043012 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:59.090272 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd2459c93dd24a808436139c866a420f', 'request_id': 'req-6092c051-a1fd-4d89-8690-be9333b4ce74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.096756 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd2459c93dd24a808436139c866a420f', 'request_id': 'req-6092c051-a1fd-4d89-8690-be9333b4ce74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.102551 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd2459c93dd24a808436139c866a420f', 'request_id': 'req-6092c051-a1fd-4d89-8690-be9333b4ce74'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.118389 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] The token cache is being invalidate because project cd2459c93dd24a808436139c866a420f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:07:59.118686 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.119650 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.121275 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1298/2620] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:07:58 2022] DELETE /identity/v3/projects/cd2459c93dd24a808436139c866a420f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:59.125480 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:59.127417 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:59.145821 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7b42f-1108-4ddc-86ac-806617b42a53 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:59.210656 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:59.211297 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:59.211823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:59.211823 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] PATH_INFO: `/v3/users/9aeac5981fca42a49b0fbe58715b5fec` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:59.212963 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aeac5981fca42a49b0fbe58715b5fec)` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:59.214893 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:59.267966 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aeac5981fca42a49b0fbe58715b5fec'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.268859 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aeac5981fca42a49b0fbe58715b5fec'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.269592 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aeac5981fca42a49b0fbe58715b5fec'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.281665 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aeac5981fca42a49b0fbe58715b5fec'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.288490 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.notifications [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aeac5981fca42a49b0fbe58715b5fec'} {{(pid=81545) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.292234 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:59.307612 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1323/2621] 10.222.0.52 () {58 vars in 1224 bytes} [Fri Oct 28 20:07:59 2022] DELETE /identity/v3/users/9aeac5981fca42a49b0fbe58715b5fec => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:07:59.492977 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Authenticating user token {{(pid=81546) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:07:59.494980 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.fernet_utils [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81546) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:07:59.514614 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092c051-a1fd-4d89-8690-be9333b4ce74 admin admin] Validating token access rules against request {{(pid=81546) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:07:59.577107 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b9dddedf69f943debb0792966846ece1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46afb98b47654c2ebe18eaaa061df1b1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81546) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:07:59.577753 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:07:59.578032 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:07:59.578302 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] PATH_INFO: `/v3/projects/5241bc4a9989442f8da28384dfda1cb7` {{(pid=81546) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:07:59.579519 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5241bc4a9989442f8da28384dfda1cb7)` {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:07:59.581451 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] RBAC: Authorization granted {{(pid=81546) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:07:59.605169 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:07:59.638946 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5241bc4a9989442f8da28384dfda1cb7', 'request_id': 'req-612a91b9-4cb6-439e-928c-751cd35086f3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.646138 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5241bc4a9989442f8da28384dfda1cb7', 'request_id': 'req-612a91b9-4cb6-439e-928c-751cd35086f3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.652030 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5241bc4a9989442f8da28384dfda1cb7', 'request_id': 'req-612a91b9-4cb6-439e-928c-751cd35086f3'} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.669221 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] The token cache is being invalidate because project 5241bc4a9989442f8da28384dfda1cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81546) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 28 20:07:59.669581 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.670739 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG keystone.notifications [None req-612a91b9-4cb6-439e-928c-751cd35086f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81546) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 28 20:07:59.672835 dv-cinder-862365-2-smb devstack@keystone.service[81546]: [pid: 81546|app: 0|req: 1299/2622] 10.222.0.52 () {58 vars in 1233 bytes} [Fri Oct 28 20:07:59 2022] DELETE /identity/v3/projects/5241bc4a9989442f8da28384dfda1cb7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 28 20:08:09.308530 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=2 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:08:09.663579 dv-cinder-862365-2-smb devstack@keystone.service[81546]: DEBUG dbcounter [-] [81546] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81546) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 20:10:42.898604 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Authenticating user token {{(pid=81545) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 28 20:10:42.900420 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:10:42.974522 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8919879-215c-4c9f-873e-f2707ec63fb2 admin admin] Validating token access rules against request {{(pid=81545) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 28 20:10:43.044362 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd595ce-3e94-4fa8-885a-85b39b842b42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762f6a1257db4dde93c6aaf2d02ca73d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd2d0dbebcef4b298390f777e361b12d', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81545) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 28 20:10:43.045013 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd595ce-3e94-4fa8-885a-85b39b842b42 service placement] REQUEST_METHOD: `GET` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 28 20:10:43.045322 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd595ce-3e94-4fa8-885a-85b39b842b42 service placement] SCRIPT_NAME: `/identity` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 28 20:10:43.045698 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd595ce-3e94-4fa8-885a-85b39b842b42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81545) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 28 20:10:43.047652 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.fernet_utils [None req-5dd595ce-3e94-4fa8-885a-85b39b842b42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81545) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 28 20:10:43.059617 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd595ce-3e94-4fa8-885a-85b39b842b42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 28 20:10:43.061203 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd595ce-3e94-4fa8-885a-85b39b842b42 service placement] RBAC: Authorization granted {{(pid=81545) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 28 20:10:43.071350 dv-cinder-862365-2-smb devstack@keystone.service[81545]: [pid: 81545|app: 0|req: 1324/2623] 10.222.0.52 () {60 vars in 1365 bytes} [Fri Oct 28 20:10:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 28 20:10:53.067103 dv-cinder-862365-2-smb devstack@keystone.service[81545]: DEBUG dbcounter [-] [81545] Writing DB stats keystone:SELECT=58 {{(pid=81545) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}